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Evidence-Based and Promising Practices 

This booklet provides indepth information about each 
intervention to help stakeholders identify and select evidence- 
based practices (EBPs) that might best fit the needs and 
preferences of communities, providers, practitioners, families, 
and youth. 
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For references, see the booklet, The Evidence. 













This KIT is part of a series of Evidence-Based Practices KITs created 
by the Center for Mental Health Services, Substance Abuse and 
Mental Health Services Administration, II.S. Department of Health 
and Human Services. 

This booklet is part of the Interventions for Disruptive Behavior 
Disorders KIT, which includes six booklets: 

How to Use the Evidence-Based Practices KITs 

Characteristics and Needs of Children with Disruptive 
Behavior Disorders and their Families 

Selecting Evidence-Based Practices for Children with 
Disruptive Behavior Disorders to Address Unmet Needs: 
Factors to Consider in Decisionmaking 

Implementation Considerations 

Evidence-Based and Promising Practices 


Medication Management 


What's in Evidence-Based Practice 
and Promising Practices 

Introduction. 

Triple P - Positive Parenting Program. 

Project ACHIEVE. 

Second Step. 

Promoting Alternative Thinking Strategies. 

First Steps to Success. 

Early Risers: Skills for Success. 

Adolescent Transitions Program. 

Incredible Years. 

Helping the Noncompliant Child. 

Parent-Child Interaction Therapy. 

Parent Management Training — Oregon. 

Brief Strategic Family Therapy. 

Problem-Solving Skills Training. 

Coping Power. 

Mentoring. 

Multisystemic Therapy. 
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Multidimensional Treatment Foster Care. 



Knowledge Informing Transformation 


Guide to EBPs 


... 1 
... 3 
. 11 
. 19 
. 25 
. 31 
. 37 
.43 
.49 
. 55 
. 61 
. 67 
. 73 
. 79 
. 83 
. 89 
. 95 
107 
113 


Interventions 
for Disruptive 
Behavior 
Disorders 
































Knowledge Informing Transformation 


Guide to EBPs 


Evidence-Based 
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Introduction 


In Selecting Evidence-Based Practices for Children with Disruptive Behavior 
Disorders to Address Unmet Needs: Factors to Consider in Decisionmaking in this 
KIT, several tables summarize information about some of the main features of the 
KIT's 18 EBPs. This booklet has indepth information about each intervention to help 
stakeholders identify and select EBPs that might best fit the needs and preferences 
of communities, providers, practitioners, families, and youth. 


18 Evidence-Based Practices Summarized in This Booklet 


Prevention / Multilevel Intervention 


■ Triple P—Positive Parenting Program 

■ Project ACHIEVE 

■ Second Step 

■ Promoting Alternative Thinking Strategies 

■ First Steps to Success 

■ Early Risers: Skills for Success 

■ Adolescent Transitions Program 


■ Incredible Years 

■ Helping the Noncompliant Child 

■ Parent Child Interaction Therapy 

■ Parent Management Training — Oregon 

■ Brief Strategic Family Therapy™ 

■ Problem-Solving Skills Training 

■ Coping Power 

■ Mentoring 

■ Multi systemic Therapy 

■ Functional Family Therapy 

■ Multidimensional Treatment Foster Care 


Evidence-Based and Promising Practices 
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The interventions are each presented in the 
same format with the following information, 
when applicable: 

■ Intervention Description 

□ Background 

□ Characteristics of the intervention 

■ Research Base and Outcomes 

■ Implementation and Dissemination 

□ Infrastructure issues 

□ Training/coaching and materials 

□ Cost of training/consulting 

□ Developer involvement 

□ Monitoring fidelity and outcomes 

□ Financing the intervention 

■ Resources/Links 

■ References 

The Intervention Description covers background 
information about the origin of the intervention, 
the developers, the population of interest, and 
essential characteristics of the intervention. 


A key part of Research Base and Outcomes for each 
EBP is a summary table that allows for quick 
access to information about the researchers, 
the design, and outcomes. These tables include 
important information from relevant studies, and 
culturally and linguistically relevant information 
from the research studies is highlighted. For most 
interventions, this means that the populations 
used in the studies have been noted. For some, 
this means that research on cultural and linguistic 
adaptations of the intervention has been included. 
For example, the booklet notes that a culturally 
adapted version of Parent Management Training — 
Oregon is being evaluated with Spanish-speaking 
Latino parents and is called Nuestras Familias. 

Implementation and Dissemination covers such 
topics as: infrastructure issues, training/coaching 
and materials, the cost of training/consultations, 
current developer involvement and contact 
information, the monitoring of fidelity and 
outcomes, and means of financing the intervention. 
This information was obtained in large part 
through telephone interviews with the developers 
of the EBPs and was then verified through edits 
and review. 

Each intervention concludes with information 
about applicable Resources, including Web links, 

and a list of References. 
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Triple P - Positive Parenting Program 


Intervention Description 


Background 

Triple P — Positive Parenting Program is a multi¬ 
level system of parenting and family support 
programs that apply to prevention, early 
intervention, and treatment. Triple P was 
developed by Matthew R. Sanders, Ph.D., and 
colleagues from the Parenting and Family Support 
Centre in the School of Psychology, University of 
Queensland in Australia. 

During the past few years, Triple P has been 
disseminated to approximately 25 organizations 
within the United States and to 15 countries. 
Dissemination has been carried out as follows: 

■ Statewide in Wyoming as the centerpiece of the 
Wyoming Parenting Initiative (more than 500 
practitioners trained to date). 

■ In 18 counties in South Carolina through the 
U.S. Triple P System Population Trial. Funded 
by the Centers for Disease Control and 
Prevention, this trial is being conducted by the 
University of South Carolina and the University 
of Queensland. 

■ At the Children’s Medical Center of Akron, 
Ohio, and other parts of Ohio. 

■ Through organizations in California, Delaware, 
Florida, Georgia, Missouri, and Pennsylvania. 

■ In 14 countries in North America, Europe, and 
the Asia-Pacific region, where Triple P 
International is disseminated. 


Figure 1 


Triple P - Positive Parenting Program 

Type of EBP 

■ Prevention/Multilevel 

Setting 

■ Clinic 

■ Home 

■ School 

Age 

■ 0-16 

Gender 

■ Males 

■ Females 

Training/Materials 

Available 

■ Yes 

Outcomes 

■ Increase in parental confidence 

■ Improvements in dysfunctional 
parenting styles 

■ Reduction in child behavior problems 


Characteristics of the intervention 

Triple P aims to prevent or reduce severe 
behavioral, emotional, and developmental 
problems in children by enhancing the knowledge, 
skills, and confidence of parents. It is designed for 
families with children from birth to 16 years of age. 
Triple P can be delivered by a range of specialists 
in the field of primary care (for example, nurses, 
physicians), mental health (for example, social 
workers, psychologists, counselors), and education 
(for example, family/parent liaisons, day care 
administrators, school counselors). 

It has been translated into 10 languages, most 
recently Spanish. Adaptations can be made for 
different cultural groups by using examples specific 
to the culture of a group. 

Triple P offers five different levels of service that 
increase in intensity as child and family needs 
increase (Sanders, Markie-Dodds, & Turner, 2003): 
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Level 1 

Level 1 is a universal prevention approach and is 
intended for all parents interested in information 
about their child’s development. Level 1 is intended 
to support communities that have already begun to 
implement the other levels of Triple P. Strategies 
include the following: 

■ Media resources (newspaper-, radio-, or 
television-disseminated community service 
announcements); 

■ Self-directed information resources (parenting 
tip sheets and videos) with information about 
how to solve developmental and minor behavior 
problems; 

■ Group presentations; and 

■ Telephone referral services. 

Level 2 

Level 2 is a brief selective intervention aimed at 
parents with specific concerns about their child’s 
behavior and development. Services include advice 
for specific child behavior problems and may be 
self-directed or involve telephone or face-to-face 
interaction with a clinician or participation in 
group sessions. 

Level 2 usually consists of one or two 20-minute 
sessions. The settings can be maternal and child 
health services, physician practices, daycare 
centers, or schools. Practitioners who deliver 
the intervention are parent-support staff in their 
respective settings. 


Level 3 

Level 3 is a more narrowly focused intervention 
designed for parents with specific concerns about 
their child’s behavior and development that require 
consultations or active parent-skills training. 
Services include one to four brief intervention 
sessions combining advice, rehearsal, and self- 
evaluation to learn how to manage specific 
behavior problems (for example, toilet training, 
tantrums, and sleep disturbances). The settings 
and practitioners are the same as in Level 2. 

Level 4 

Level 4 is a more broadly focused parent training 
intervention for parents wanting intensive training 
in positive parenting skills for children with more 
severe behavior problems. Eight to 10 sessions 
focus on improving parent-child interaction, 
applying parenting skills to a broad range of 
focused behaviors, and generalizing skills. Services 
may combine self-directed strategies, telephone 
or face-to-face meetings with a clinician, or group 
sessions. Practitioners are mental health, child 
welfare, or other health care professionals. 
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Level 5 

Level 5 is the Enhanced Triple P and is an 
intensive, individually tailored intervention for 
families that have children with behavior problems 
and other family stressors (for example, parent 
depression, partner conflict). Services include 
the following: 

■ Active parenting-skills training; 

■ Home visits; 

■ Mood management; 

■ Stress coping skills; and 

■ Partner support skills. 

Services may involve self-directed strategies, 
telephone or face-to-face meetings with a clinician, 
or group sessions. Practitioners are mental health, 
child welfare, or other health care professionals. 

Modified levels are also available to meet the 
developmental needs of the children and parents, 
such as a self-directed workbook for parents. 


Research Base and Outcomes 

Triple P has a strong research base that includes 
multiple studies and evaluations dating back to 
1977. The research assesses the effectiveness of 
various levels of Triple P for children from infancy 
to 16 years of age. 

Research designs include 29 randomized clinical 
trials (RCT), 11 controlled single-subject 
evaluations, 9 effectiveness evaluations, 6 
dissemination trials, and papers examining 
predictors, mediators, and moderators of 
intervention effects. Culturally and ethnically 
diverse research studies include one RCT with 
samples of children from China. Triple P has been 
evaluated with people treated in a broad array of 
settings including health care, mental health, social 
services, education, community centers, and 
workplaces. Trends in outcomes are evidenced 
by the specific studies referenced in Table 1. 


Evidence-Based and Promising Practices 
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Table 1: Triple P - Positive Parenting Program: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Sanders & 

Christensen (1985) 

Randomized Control Trial (RCT) of families (n = 20) with a 
child (2-7 years) with Oppositional Defiant Disorder (ODD) 
comparing Child Management Training (Standard Triple P / 

Level 3) without planned activities training and Standard 

Triple P (Level 4). 

Both interventions demonstrated: 

■ Significant reductions in observed child disruptive behavior 
and mother aversive behavior. 

■ Significant increased use of focused parenting strategies. 


Study population: 

■ 60% Male 

■ 40% Female 


Connell, Sanders & 
Markie-Dadds (1997) 
(in Sanders, Markie- 
Dadds, & Turner, 

2003) 

RCT of families (n = 60) with a child (age 7-12) comparing 
Enhanced Triple P (for stepfamilies), Enhanced Self-Directed 

Triple P and a waitlist (WL) control parents and stepparents 
of children with ODD or (Conduct Disorder) CD. 

■ No differences found between the therapist-directed and 
self-directed programs. 

■ Children in intervention groups showed significant reductions 
in parent reported disruptive behaviors. 


■ Significant reductions in parenting conflict were reported by 
parents and stepparents in the intervention conditions only. 

Sanders, Markie- 
Dadds, Tully & Bor 
(2000) 

RCT comparing Standard Triple P, Self-Directed Triple P, 

Enhanced Triple P and a waitlist (WL) control of parents 
(n = 305) with children (mean age of 3 years) with clinically 
elevated disruptive behavior, and at least one family adversity 
factor (for example, low income, maternal depression, 
relationship conflict, single parent). 

Study population: 

■ 68% Male 

■ 32% Female 

■ Children in the three intervention conditions showed greater 
improvement on mother-reported disruptive behaviors than 
the waitlist (WL) control. 

■ Only those in the Enhanced Triple P and the Standard Triple 

P conditions showed significant improvement on observed 
disruptive child behavior and father reports. 

■ Parents in two practitioner-assisted programs also showed 
significant reduction in dysfunctional parenting strategies 
(self-report) for both parents. 


■ Predominately White 


Sanders & McFarland 
(2000) 

RCT of parents (n = 47) with a child (3-9 years) with ODD 
or CD and mothers with major depression comparing Standard 
Triple P and Enhanced Triple P. 

Both interventions demonstrated: 

■ Reduction in observed and parent reported disruptive 
child behavior. 

■ Reductions in parental levels of depression. 

■ Increase in parental confidence. 

Ireland, Sanders, & 
Markie-Dadds (2003) 

RCT of families (n = 44) concerned about their child's (2-5 
years) disruptive behaviors and concurrent clinically elevated 
marital conflict. Families assigned to Group Triple P or Group 
Triple P with a partner support module. 

Both interventions were associated with significant: 

■ Improvements in parent-reported disruptive behavior. 

■ Reduction in dysfunctional parenting strategies. 

■ Reduction in parenting conflict. 

■ Improvements in relationship satisfaction and 
communication. 

Bor, Sanders, & 
Markie-Dadds (2002) 

RCT with parents of children (n = 87, Mean age = 3) with co- 
morbid significantly elevated disruptive behavior and attention 
problems. 

Study population: 

■ 68% Male 

■ 32% Female 

■ Predominately White 

■ Both intervention programs were associated with significantly 
lower parent reported child behavior problems and 
dysfunctional parenting and significantly greater parenting 
confidence. 

■ No condition effects were found for parent or teacher reports 
of disruptive behavior or for parental adjustment, parenting 
conflict or relationship satisfaction. 

Leung, Sanders, 

Leung, Mak, & Lau 
(2003) 

RCT of Chinese parents in Hong Kong (n = 91) with children 
(3-7 years) with conduct-related problems assigned to either 
Triple P intervention group (n = 46) or the waitlist control 
group (n = 45). 69 completed the study, 25 female and 

44 male. 

Study population: 

■ 100% Chinese 

Intervention was associated with significant: 

■ Reduction in child behavior problems. 

■ Reduction in dysfunctional parenting styles. 

■ Increase in parental confidence. 


*Study sample's gender and race/ethnicity data provided where available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness 

Triple P America does not have specific readiness 
assessments, but relies instead on initial information- 
gathering conversations with sites to clarify their 
needs and determine how Triple P interventions 
might address these needs. 

Stakeholder buy-in: 

■ The intervention focuses on five developmental 
periods from infancy to adolescence. Within 
each period, the reach of the intervention 

can vary from being very broad (focusing 
on an entire population) to quite narrow 
(focusing only on high-risk children). 
Stakeholders must buy into the approach 
of specifying developmental periods. 

■ It is important to have buy-in of managers, 
supervisors, families and family advocacy 
groups, and executive level decisionmakers 
that control funds. 

■ Triple P should be integrated into a community 
or organization’s strategic plan. 

Possible barriers: 

A specific barrier to successful implementation 
occurs when the agency or staff do not work with 
families at times that are convenient for families. 
This potential barrier is not specific to Triple P 
but rather to any parenting or family intervention. 


Training/coaching and materials 

■ The level of the Triple P intervention that is 
implemented and the setting determines the 
preservice level of training. For Levels 2 and 3 
(described previously) paraprofessionals that 
consult with families around parenting are 
eligible for training, whereas Levels 4 and 5 
require more clinically trained professionals. 

■ Training consists of two onsite visits of 2 to 3 
days each in which intensive training is followed 
by practice and competency demonstrations. 
There are 8 to 10 weeks between the first and 
second onsite training visits. The training 
methods include didactic presentation, self- 
study with practitioner manuals, videos, active 
practice and discussion in small groups, and 
roleplaying. People who successfully complete 
the training become accredited Triple P providers. 

■ All of the training is delivered by Triple P 
America. No established structure exists for 
training trainers. To deal with staff turnover, 
agencies may send staff to other sites where 
training is being held and pay for the individual 
training slots used. 

■ Manuals, facilitator kits, and training are 
available through the Triple P Institute. 

The Triple P Web site is easy to navigate and offers 
a detailed explanation about the intervention 
and cost involved (http://www.triplep-america.com). 
For information about accessing training, 
contact Dr. Ron Prinz. 

Dr. Ron Prinz 
Triple P America 
4840 Forest Drive, #308 
Columbia, SC 29206 
triplepa@bellsouth.net 
(803) 787-9944 
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Cost of training/consulting 

■ According to Triple P America, the most cost- 
efficient way of implementing the Standard 
Triple P (Level 4) is to train a group of 20 
practitioners. The cost for training a group 
this size is $21,000, which includes two training 
visits involving 3 days for the first visit and 2 
days (10 practitioners per day) for the second 
visit. This amount also covers the practitioner 
manuals, a practitioner kit, and a video for 
parents, as well as all of the trainers travel costs. 

■ For small organizations that do not have 20 
staff members, an alternative is to develop 
collaborative training with other agencies. 

■ Triple P America does not encourage long-term 
or intensive ongoing consultation. Consultation 
services are available on a contractual basis. 

■ Additional costs must be considered for the 
self-directed parenting resource materials. 

In addition, at higher levels of Triple P, there 
will be a cost for covering home visits if these 
are required at the level being implemented. 


Developer involvement 

■ Triple P America is the primary disseminator 
of Triple P in the United States. 

■ Triple P America’s trainer staffing pattern 
is flexible. It can usually expand its capacity 
to accommodate new sites. 


■ The goal of Triple P America is for sites to 
become independent through their initial 
training and consultation, through the quality 
of their materials and Web site, and by using 
a self-regulatory framework in peer support 
networks and supervision. 

■ For ongoing implementation, Triple P attempts 
to meet sites’ needs through telephone, email, 
or site visits when needed, but they do not 
encourage long-term dependence. 


Monitoring fidelity and outcomes 

■ Fidelity checklists are included in the manuals 
for every level of the Triple P intervention. 
These checklists facilitate self and supervisor 
tracking of intervention implementation 

and fidelity. 

■ Triple P does not have any requirements 
related to ongoing fidelity monitoring. It is the 
responsibility of each organization to ensure 
fidelity and to measure outcomes. However, 
every Triple P manual has designated 
measurement instruments that are suitable 
for outcome measurement. 


Financing the intervention 

Funding used for startup costs of Triple P include 
grants, state funds, and agency budgets. (R. Prinz 
personal communication, March 22, 2006.) 
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Resources/Links 

Triple P-America Web site: 

http://www.triplep-america.com. 
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Project ACHIEVE 


Intervention Description 


Background 

Project ACHIEVE is a universal, school-based 
intervention that applies to many educational 
settings. Howard M. Knoff, Ph.D., developed 
Project ACHIEVE and is its director. He also 
works as the director of the federally funded State 
Improvement Grant for the Arkansas Department 
of Education’s Special Education Unit in Little 
Rock, Arkansas. 

Project ACHIEVE training has been conducted 
in more than 1,500 schools and districts in 40 states 
since its inception in 1990. 


Characteristics of the intervention 

Project ACHIEVE is a comprehensive school- 
based prevention program that focuses on several 
different areas, including academic engagement 
and achievement, positive behavioral support 
systems, school safety, and parent and community 
involvement. It was designed for use in preschools 
and elementary and middle schools for children 3 
to 14 years of age, and has been implemented in 
alternative schools, charter schools, self-contained 
special education facilities, and select high schools. 

Teachers and school administrators are responsible 
for delivering and sustaining Project ACHIEVE, 
which is implemented over a 3-year period by 
following carefully sequenced steps. 


The intervention uses professional development, 
inservice training, and onsite technical assistance 
and consultation to train school personnel at each 
facility. Consultation and training services are 
provided directly by Dr. Knoff and his master 
trainers. Most work is completed onsite, with 
offsite technical assistance available. All materials 
are available in English with some also available 
in Spanish. 


Figure 2 


Project ACHIEVE 

Type of EBP 

■ Prevention/Multilevel 

Setting 

■ School-based (including 
alternative schools and charter 
school programs) 

Age 

■ 3-14 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Decrease in discipline 
problems. 

■ Decrease in Special Education 
referrals and placements. 

■ Increase in positive school 
climate. 

■ Improvements in academic 
achievement. 
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Project ACHIEVE s seven components are 

as follows: 

1 . The Strategic Planning, Organizational Analysis, 
and Development Component focuses on assessing 
the organizational climate, administrative style, 
staff decisionmaking, and other interactive 

and interpersonal processes within a school. 
Important to this component is developing 1- 
and 3-year school improvement plans. 

2. The Problem Solving, Teaming, and Consultation 
Processes Component focuses on the causes 

of students’ behavior and on assessment 
leading to intervention to improve behavior. 

This response-to-intervention component 
emphasizes a problem-solving/consultation/ 
intervention mode of operation that directly 
contrasts with past wait-to-fail and refer-test- 
place approaches, and is applied with students 
experiencing academic and behavioral concerns. 

3. The Effective School, Schooling, and Professional 
Development Component focuses on helping 
students maximize their time spent on 
academics and other school-related tasks. 
Professional- and development-related activities 
are highlighted in this component to increase 
the knowledge, skill sets, and confidence of 
teachers, administrators, or counselors who 
implement the program. 

4. The Academic Instruction Linked to Academic 
Assessment, Intervention, and Achievement 
Component matches students’ current academic 
challenges to the appropriate curriculum 

to improve their overall performance. 

The instructional environment consists of the 
interdependent interactions in a classroom of 
the teacher-instructional process, the student, 
and the curriculum. 

5. The Behavioral Instruction Linked to Behavioral 
Assessment, Intervention, and Self-Management 
Component assesses and focuses on a student’s 
behavior by matching it with appropriate 


behavioral interventions and classroom 
management procedures. Using Project 
ACHIEVES evidence-based Positive 
Behavioral Self-Management System, 
this whole-school approach involves students, 
staff, administration, and parents building 
and reinforcing the following: 

■ Students’ interpersonal, problem-solving 
and conflict-resolution skills and interactions; 

■ Positive, safe, supportive, and consistent school 
climates and settings; and 

■ School and district capacity such that the entire 
process becomes self-sustaining. 

6. The Parent and Community Training, Support, 
and Outreach Component connects parents 
to the school to promote collaboration and 
improve the chances of students’ success in 
school. The theory is that using coordinated 
community-based efforts will increase support, 
resulting in more positive outcomes. 

7. The Data Management, Evaluation, and 
Accountability Component assesses outcomes 
collected through consumer satisfaction 
methods and other data, such as time and 
cost-effectiveness of the overall Project 
ACHIEVE intervention, as well as students’ 
academic and behavioral progress. 


Research Base and Outcomes 

Project ACHIEVES effectiveness has been 

demonstrated through the following: 

■ One quasi-experimental design; 

■ One qualitative design program evaluation 
using semi-structured interviews conducted 
by the American Institutes for Research 
through a contract with the U.S. Department 
of Education’s Office of Special Education 
Programs (OSEP); and 
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■ Continued longitudinal studies from research 
school sites. Project ACHIEVE results are also 
reported annually in Arkansas as a part of its 
state improvement grant, through which 
approximately 45 schools are implementing 


Project ACHIEVE as part of a 5-year grant from 
the U.S. Department of Educations OSEP. 

As seen in Table 2, research has included White, 
African American, and Hispanic participants. 


Table 2: Project Achieve: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Knoff & Batsche (1995) 

Quasi-experimental design with matched comparison of one 
elementary-level treatment school and one control school. Data 
collected in treatment school for 1 year pretreatment and 3 years 
posttreatment. Data collected in control school for 1 year. 

Study population: 

Treatment school: 

■ 60% White 

■ 30% African American 

■ 10% Other 

Comparison school: 

■ 41% White 

■ 54% African American 

■ 6% Other 

For the treatment school: 

■ Decrease in referrals for special education. 

■ Decrease number of students placed in special 
education. 

■ Decrease in disciplinary referrals. 

■ Decrease in student grade retention, decrease in 
incidences of out-of-school suspension, positive gains 
on the California Test of Basic Skills. 

Killian, Fish, & 

Maniago (2006) 

Pre-post study with a comparison group. Participants were 
students in grades 3-6, and their parents and guardians. Students 
in the treatment school received Project ACHIEVE curriculum. Date 
collected before implementing the curriculum and at 1-year post¬ 
implementation. 

For the treatment school: 

■ Consistent decreases in undesirable behaviors occurred 
across all grades in both classroom and non-classroom 
settings. 

■ Decreases in serious offenses—for example, in the areas 
of theft and students' use of physical force. 

■ Decreased discipline referrals to the principal's office. 

■ School suspensions for disciplinary reasons decreased. 

Project ACHIEVE 
research school results 

Knoff personal 
communications (2006) 

Longitudinal data collection from designated research schools. 

No control group comparison. 

Study populations by school: 

Jessie Keen Elementary School 

■ 60% White 

■ 30% African American 

■ 10% Other 

Cleveland Elementary School 

■ 20% White 

■ 62% African American 

■ 17% Hispanic 

■ 1 % Other 

Hotchkiss Elementary School 

■ 14% White 

■ 42% African American 

■ 39% Hispanic 

■ 5% Other 

Overall discipline referral to office decreased 16%. 

■ School-based discipline referrals decreased 11%. 

■ School bus discipline referrals decreased 26%. 

■ Out-of-school suspension decreased 29%. 

■ Grade retention decreased 47%. 

■ Special Education referrals decreased 61%. 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

■ Sites undergo a formal readiness assessment to 
determine their organizational and motivational 
readiness and ability to implement the program. 

■ Project ACHIEVE will work with sites 
for 12 to 18 months to build their capacity 
for implementation, should they not already 
have the capacity to implement the program. 

Staffing: 

■ Project ACHIEVE has a set of broad-based 
criteria for sites to use to help them hire staff 
to implement the program. 

■ One prerequisite is an organizational analysis 
and realignment (if needed) of the committee 
structure of the school and the development of 
a master calendar of meetings and professional 
development activities. 

■ A resource analysis is completed to identify the 
instructional, assessment, and intervention skills 
of staff in and available to the school. 

■ School administration and teachers are 
actively involved in implementing the program. 

Facilitators are chosen to receive additional 
training so they can guide the program and 
interventions in future years, at times through 
the DVD series, along with the ongoing 
support training provided by Dr. Knoff 

and his master trainers. 


Family and child involvement: 

■ Consumers play a role in implementation, 
especially in designing and implementing 
the Positive Behavioral Self-Management 
System and through activities organized and 
implemented by the Community and Family 
Outreach Committee. Students are involved in 
the core components of the process but are not 
directly involved in the decision about whether 
Project ACHIEVE is brought to the school. 

■ Dr. Knoff is involved with the community, 
especially when social and cultural norms within 
the community make it important (for example, 
in American Indian communities). He often 
presents at Parent Nights to discuss home- 
based discipline and behavior management, 
and he attempts to engage families through his 
involvement in individual intervention-focused 
cases in the school. 

Implementation timeline: 

Project ACHIEVE is a 3-year intervention with 

carefully sequenced steps that must be followed. 

A sample timeline is as follows (H. Knoff, personal 

communication, June 22, 2006): 

■ Pre-Year 1 : Organizational development and 
strategic planning; writing of Project ACHIEVE 
goals and objectives in the School Improvement 
Plan; evaluating the school’s mission statement, 
organizational/committee structure, and 
resources; completing articulation activities 
and audits relative to problem areas in the 
school, early intervention referrals, and 
identifying students who need interventions 

for the next school year. 

■ Year 1 : Social skills training, SPRINT Problem 
Solving training (separate sessions for the entire 
staff and specialists/study team), release time 
for planning, meetings, and technical assistance. 
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■ Year 2: Social skills/SPRINT training and 
booster sessions, Behavioral Observation and 
Instructional Environment Assessment training, 
Curricular-Based Assessment and Measurement 
(CBA/CBM) training, academic and behavioral 
intervention training; release time for planning, 
meetings, and technical assistance. 

■ Year 3: Booster sessions in all components; 
parent-involvement planning; training and 
facilitation; grade-level intervention planning 
and implementation; leadership and facilitators’ 
training; release time for planning, meetings, 
and technical assistance. 

■ Beyond Year 3: Continued, sustained 
implementation of all components; academic 
and behavioral intervention focus for students 
not responding to interventions; continued 
release time for all grade-level teams to plan 
and implement the activities identified on their 
Action Plans; additional consultation and 
technical assistance as needed. 

Possible barriers: 

■ Some of the barriers to effective 
implementation are as follows (H. Knoff, 
personal communication, June 22, 2006): 

■ Organizational, administrative, financial, 
and resource limitations. 

■ The lack of personnel skilled in implementing 
and providing consultation and technical 
assistance in academic and behavioral 
interventions for students not responding to 
effective instruction and preventative strategies. 

■ Administrative personnel taking the time to 
learn about the program to make it the central 
feature of the School Improvement Plan and 
process. Not focusing attention to proactive 
versus reactive activities. 

■ Systemic barriers that may be locally driven. 


■ Certain mandates when the school focuses 
largely on classroom instruction, academic 
assessment, and academic outcomes to the 
detriment of other Project activities that more 
effectively support these important areas. 

■ The availability of trained personnel and the 
willingness of administrators to rethink using 
these personnel as consultants, along with their 
direct service responsibilities. 

■ The loss of principals, other administrators, and 
staff who leave the school or system after being 
trained, only to be replaced by new staff who 
need training. This occurs sometimes in the first 
year of the project. 


Training/coaching and materials 

■ Depending on the existing status and skills of 
school staff, training typically involves 5 to 8 
days during Year 1; 4 to 8 days during Year 2; 
and 4 to 6 days during Year 3. With consultation, 
travel, and material costs, Year 1 costs average 
approximately $30,000 to $35,000; Year 2 costs 
average approximately $20,000 to $25,000; and 
Year 3 costs average approximately $15,000. 

■ Dr. Knoff and his five to six master trainers 
are available for onsite consultation, booster 
sessions, and offsite assistance such as web- 
based training, teleconferencing, and web 
conferencing. 

■ A 12-set DVD series has all the content that 
helps in training the staff, who are considered 
to be facilitators. All personnel are actively 
involved in implementing the program, but 
Dr. Knoff works most closely with the school 
principal, whom he considers to be the CEO 
of this process; the chairs of the school 
improvement, discipline, SPRINT, and 
community and family outreach committees; 
and the various members of these committees. 
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■ Training may vary according to the site, but 
ultimately it is a three-pronged approach aimed 
at providing knowledge, skills, and confidence. 
Demonstrations, consultation, technical 
assistance, and supervision are also provided. 

■ There are materials for the Stop and Think 
Social Skills program that are readily available 
for purchase. Schools are advised to commit 
to implementing Project ACHIEVE fully, 

as opposed to just purchasing the materials. 

The following items are available for purchase: 

■ Stop & Think Social Skills Program 
(book, cue cards, stickers, stamps, t-shirts, 
pencils, and other materials for use in the 
classroom). Materials available for purchase 

at Sopris West Publishers (1-800-547-6747) or 
http://www.sopriswest.com. 

■ The Stop & Think Social Skills Program for 
Parents (involving a manual and 75-minute 
training DVD) is available through Dr. Knoff. 

Information on training and materials can be 
obtained at: http://www.projectachieve.info. 


Cost of training/consulting 

■ Costs will vary, but on average it costs $25,000/ 
year ($75,000 total) to implement (see above). 

■ Cost per pupil to implement ranges from $30 
to $ 150/per student, many times it depends 
on the need and cost of substitute teachers 

to release staff for training and other activities. 

■ All of these costs include consulting services, 
travel, and materials (printed and DVD). 


Developer involvement 

■ Dr. Knoff is still actively involved in providing 
consultation services (onsite/offsite), writing 
research reports, and assessing readiness for a 
school to implement Project ACHIEVE. 

■ Dr. Knoff has a fully prepared grant insert that 
can be provided to those writing state, Federal, 
and foundation grants that will involve Project 
ACHIEVE implementation. 

For information about implementing Project 
ACHIEVE, contact Dr. Knoff. 

Howard M. Knoff, Ph.D. 

49 Woodberry Road 

Little Rock, AR 72212 

Phone: (501) 312-1484 

Fax: (501) 312-1493 

Email: knoffprojectachieve@earthlink.net 


Monitoring fidelity and outcomes 

■ A series of implementation check sheets address 
the different facets of the project to be used in 
monitoring adherence to the protocol. 

■ Two formal questionnaires for evaluating the 
discipline and behavior management attitudes 
and staff interaction characteristics of the school 
are used as pre- and post-measures of 
organizational development and change. 

■ Formal fidelity measures have been developed 
through a number of Federal and state grants 
that have implemented Project ACHIEVE 

in various schools. 
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■ Discipline data is collected through a free 
software program, the Automated Discipline 
Data Review and Evaluation Software System 
(ADDRESS), which is loaded directly onto a 
school’s computer system and used in-house. 

■ Through the onsite consultation services, the 
developer and master trainer develop other 
outcome measures designed to sensitively 
evaluate each year’s Project ACHIEVE goals 
and objectives as written into the School 
Improvement Plan. 


Financing the intervention 

Schools and districts have used several different 
funding sources to help finance Project ACHIEVE: 

■ Title I funds of the Elementary and Secondary 
Education Act of 1965 (20 U.S.C. 6301 et seq.) 

■ Special education funds 

■ School improvement funds 

■ Safe and Drug-Free School funds 

■ Safe Schools/Safe Community funds 

■ Counseling in the Schools funds 

■ Private foundation funding 

■ No Child Left Rebind funds 

■ Medicaid dollars for services that are part of the 
program (but cannot reimburse for the entire 
program itself) 


Resources/Links 

For more indepth information about Project 
ACHIEVE, please visit the following Web sites: 

■ Helping America’s Youth: 

http://www.findyouthinfo.gov/ 

■ Project ACHIEVE Home Page: 

http://www.projectachieve.info 

■ U.S. Department of Health and Human 
Services/Substance Abuse and Mental Health 
Services Administration, National registry of 
Evidence-Rased Programs and Practices: 

http://www.nrepp.samhsa.gov/ 

■ U.S. Department of Justice/Office of Juvenile 
Justice and Delinquency Prevention: 

http://www.ojjdp.gov.mpg 

■ American Institutes for Research/Center 
for Effective Collaboration and Practice: 

http://cecp.air.org/ 

■ U.S. Department of Health and Human 
Services, Substance Abuse and Mental Health 
Services Administration, Center for the 
Application of Prevention Technologies: 

http://captus.samhsa.gov/ 

■ Collaborative for Academic and Social- 
Emotional Learning: http://www.casel.org 

■ The Arkansas State Improvement Grant: 

http://www.arstateimprovementgrant.com 
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Second Step 


Intervention Description 


Background 

The Second Step program is a universal prevention 
and intervention program for children ages 4 tol4. 
The program, developed in the mid-1980s, is 
disseminated by the Committee for Children, 
an organization based in Seattle, Washington. 
With wide implementation throughout the United 
States and 21 other countries and regions, the 
Second Step program is currently being taught 
to more than 7 million children with over 21,000 
trained practitioners. 


Characteristics of the intervention 

The Second Step program is a classroom-based 
prevention program designed to reduce impulsive 
and aggressive behavior. It is classified as a 
prevention program and is therefore appropriate 
for most children. 

The program is divided into the following three 
main skill-building areas: 

■ Empathy; 

■ Impulse control and problem solving; and 

■ Anger management. 

It is delivered in sequential lessons by classroom 
teachers or counselors using curriculum kits. 


The Second Step program focuses on the following 
three age groups: 

■ Preseh ool/kindergarteri; 

■ First through fifth grade; and 

■ Middle school. 

In the youngest group, students are exposed to 
photo-lesson cards, puppets, and sing-alongs that 
facilitate group discussions, skill practice, and 
transfer of learning. In the elementary age group, 
students are exposed to videos, photo-lesson cards, 
teacher-led discussions, role plays, and homework, 
all addressing the three skill areas. 

The middle school curriculum uses fully scripted 
lessons, videos, and reproducible activity sheets. 
Also, a family guide helps families reinforce 
social and emotional skills at home, including 
communicating feelings, solving problems, 
and managing conflict. 


Figure 3 


Second Step 

Type of EBP 

■ Prevention 

Setting 

■ School 

Age 

■ 4-14 years 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Increase in prosocial behavior 
and social reasoning. 

■ Improvement in self-regulation 
of emotions. 

■ Decreased verbal and physical 
aggression. 

■ Decreased behavioral problems. 
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Research Base and Outcomes 

At least a dozen research studies examined the 
Second Step program. In outcome measures 
collected from direct observations and child 
interviews, support exists for the intervention in 
reducing behavior problems, decreasing physical 
aggression, and increasing prosocial behavior. 


Outcome measures collected from teacher ratings 
were either not supported by the research or not 
present over time. Studies have included White, 
African American, and Hispanic participants. 

Information about research conducted on the 
Second Step program is shown in Table 3. 


Table 3: Second Step: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Grossman et al,. 

(1997) 

The first randomized control trial design with children (n = 790, grades 

2 and 3) from six matched pairs of schools. Assigned to either the Second 
Step intervention group or the control group. 

Outcomes were collected at three points: before the intervention, 2-week 
followup, and 6-month followup. Trained observers, parents, and teachers 
provided the rating of the students' behavior. 

Immediate results at the end of the intervention 
for treatment group: significant decreases in 
observed physical aggression and significant 
increases in observed neutral/prosocial behavior. 

Most significant changes not present at 

6-month followup. 


Study population: 

■ 53% Male 

■ 37% Female 

■ 79% White 


McMahon, Washburn, 
Felix, Yakin, & Childrey 
(2000) 

Quasi-experimental design with pre- and post- evaluation of 
predominantly African American and Hispanic children (n = 109, 
ages 3-7). 

Significant gains in knowledge collected in 
interviews and decreases in problem behaviors 
found on the basis of direct observations. 


Data collected through child interviews (assessing knowledge and 
skills related to empathy, impulse control, problem solving, and anger 
management), teacher ratings, and behavioral observations. 

Study population: 

■ 42% Male 

■ 58% Female 

■ 78% African American 

■ 21% Hispanic 

■ 1% White 

However, teachers' ratings did not change 
significantly from the pre-intervention to 
post-intervention. 

Taub (2002) 

Quasi-experimental evaluation of the Second Step curriculum among 

3rd through 5th grade students (n = 54) in a rural elementary school. 

Teachers rated children's social competence and antisocial behavior, 
and observers rated children's prosocial behaviors. 

Compared to the control group, students who 
received Second Step lessons increased in social 
competence and decreased in antisocial behavior. 

Observational data further validated that 
program students showed higher levels of peer 
interaction skills and rule-adherence compared to 
control students. 

Van Schoiack-Edstrom, 
Frey, & Beland (2002) 

Quasi-experimental evaluation of the Second Step Middle School 
curriculum to examine the effects on levels of and attitudes toward 
physical and relational aggression in 6th and 7th grade students from 
five schools (n = 714) from the United States and Canada. 

Two-thirds of the students were taught Second Step lessons over a year; 
the remaining third were not. 

Study population: 

■ 49% Male 

■ 51% Female 

■ Schools ranged from 4-89% White. 

6th grade students who received the Second Step 
program endorsed less social exclusion; the 7th 
grade females showed less endorsement of physical 
aggression, and both females and males receiving 
the program perceived less social difficulty. 

No differences were found for social exclusion. 

Results indicate that the Second Step program has 
potential for modifying attitudes toward aggression 
and reducing relational aggression among 
early adolescents. 
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Table 3: Second Step: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

McMahon & 

Washburn (2003) 

Pre- and post-study among 5th through 8th grade African American 
students (n = 156) to evaluate the impact of the Second Step Middle 

School curriculum on social skills knowledge, aggressive behavior, 
prosocial behavior, and school bonding. 

Study population: 

■ 36% Male 

■ 64% Female 

■ 100% African American 

Students who participated in the Second Step lessons 
increased social skills knowledge and prosocial and 
empathy skills. 

Changes in empathy were also related to lower levels 
of aggression at posttest. 

Frey, Nolen, Van 
Schoiack-Edstrom, 

&- Hirschstein (2005) 

Children (n = 1253, ages 7-11) from 15 elementary schools assigned 
to the Second Step intervention group or the control group. Students' 
behavior and progress assessed with self-reports, teacher ratings, and 
direct observations. 

Study population: 

Approximate school populations 

• 51% Male 

■ 49% Female 

■ 70% White 

■ 18% Asian American 

■ 12% African American 

Intervention group demonstrated a greater increase 
in prosocial behavior and social reasoning than the 
control group. 

Differences in teacher ratings of behavior were 
present at Year 1 but not Year 2. 

Edwards, Hunt, 

Meyers, Grogg, 

& Jarrett (2005) 

Sample of 4th and 5th grade students (n = 455) to investigate the 
effectiveness of a version of the Second Step curriculum adapted to 
include an anti-bullying component. 

Study population: 

■ 32% Hispanic 

■ 31 % African American 

■ 30% White 

Students showed significant gains in knowledge 
about empathy, anger management, impulse 
control, and bully-proofing. 

Report card data also revealed modest gains in 
prosocial behavior. 

Schick & Cierpka 
(2005) 

Experimental study among children (n = 335, ages 5-8) who 
participated in Faustlos (German version of the Second Step program). 
Change in empathy and aggression was assessed against the control 
group by teachers and parents who completed a measure of internalizing 
and externalizing behaviors. 

Study population: 

■ 51% Male 

■ 49% Female 

■ 100% German 

Students who participated in the Second Step 
program showed significant declines in anxious, 
depressed, and socially withdrawn behavior 
compared to the control groups, based on parents' 
ratings. 

Parent reports also revealed significant gender 
differences: Only girls in the experimental group 
showed decreases in physical aggression and 
increased social competence when compared to 
control students. 


* Study sample's gender and race/ethnicity data provided when available. 
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The Second Step Staff Training is a 1-day course 
designed to help participants learn to teach the 
Second Step curriculum to students. This training 
provides hands-on experience with the curriculum 
and helps teachers strengthen social-skills teaching 
techniques and identify opportunities to model 
and reinforce skills. As part of the program, 
each site receives a set of four staff-training videos 
that can be used to reinforce the skills that were 
learned and train new staff. (This training is 
available only onsite.) 

Information about training and 
materials can be obtained at: 

http://www.cfchildren.org/programs/ssp/overview/ 


Cost of training/consulting 

■ The regional Second Step Training for Trainers 
costs $499 per person ($399 per person if 
registered by Early Bird Discount deadline 
designated for each location). 

■ The maximum number of people recommended 
for the onsite Second Step Training for Trainers 
is 40 people. The cost for 25 people is $4,975. 
Each additional person is $100. The total cost 
for a training of 40 is $6,475 plus travel- 
related expenses. 

■ The onsite Second Step Staff Training costs 
$1,600 plus travel-related expenses. 

■ After participants have attended one initial 
training session, Committee for Children 
trainers are available to provide onsite 
consultation, booster sessions, or additional 
training. The fee for this service is $125 
per hour. 

■ The cost for materials will vary according to 
the curriculum kits purchased and ranges from 
$159 to $289. Volume discounts are available 
for orders over a certain size. 

■ No certification is needed to implement 
the Second Step program. 


Developer Involvement 

The organization’s program developers dedicate 
themselves to ongoing revision of the programs 
to maintain their effectiveness. The Committee 
for Children also remains focused on sustained 
partnerships with clients anchored in outstanding 
customer support and training and directed to 
clients’ long-term success. 

For more information, visit the 
Committee for Children’s Web site: 

http://www.cfchildren.org/programs/ssp/overview/ 


Monitoring fidelity and outcomes 

Evaluation instruments are available for school 
and district administrators to gauge fidelity of 
implementation and assess outcomes of the Second 
Step program. 

Sites are not required to submit fidelity or outcome 
data. The Committee for Children monitored the 
outcomes during the pilot phase for the Second 
Step program. 


Financing the intervention 

According to C. Glaze (personal communication, 

June 21, 2006): 

■ Approximately 80 percent of those who 
implement the Second Step program use 
Safe and Drug Free Schools funding to 
purchase the curriculum. 

■ Often, some of the resources required for 
training services derive from a site’s staff 
development budget. 
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Resources/Links 

Committee for Children: http://www.cfchildren.org. 

Training Information: 

http://www.cfchildren.org/programs/ssp/overview/ 

Office of Juvenile Justice and Prevention 
Programs: http://www.dsgonline.eom/mpg2.5// 
TitleV_MPG_Table_lnd_Rec.asp?id = 422 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

The Committee for Children offers unlimited, 
free implementation support for the Second Step 
program. A knowledgeable team of program 
implementation specialists, all former educators, 
is available by phone to help interested parties 
plan for, implement, and sustain the program. 

Additional support is available in the form of 
written materials that provide detailed information 
on a range of topics, such as how to secure buy-in, 
develop roll-out plans, involve families, provide 
ongoing support, and evaluate the program. 

A funding specialist is on staff to provide up-to-date 
grant announcements and funding opportunities. 

Possible barriers: 

■ Lack of sponsorship at school or district level. 

■ Lack of buy-in — No commitment on the part 
of teachers and other adults responsible for 
implementing the program. 

■ Lack of time—Some mandates have influenced 
school districts to focus solely on academics, 
leaving little room for social and emotional 
learning programs. 

■ Constant leadership changes in administration 
affect the ability to sustain program 
implementation over time. 

■ Lack of funding. 

■ Lack of parent or caregiver involvement, hence 
no support outside of the classroom setting. 

■ No ongoing implementation support. 


Training/coaching and Materials 


Training models 

The Committee for Children offers two training 
models for the Second Step program. The 
organization hosts 25 to 30 regional trainings 
in cities across North America. Attendance at 
a regional training allows participants to network 
with professionals outside their organization and 
can be a more cost-effective option when looking 
to train one person or a small group of people. 

Committee for Children trainers are also available 
for travel to any community to deliver onsite 
Second Step training exclusively for school, agency, 
or district staff, providing the opportunity to plan 
program implementation as a group, address local 
issues, and network with colleagues. 


Training programs 

The Second Step Training for Trainers is a 214-day 
course designed to help participants learn to teach 
the curriculum efficiently and return to their 
schools or agencies to conduct their own staff 
trainings, thus providing “local expertise.” 

In addition, participants can provide ongoing 
“booster” trainings, train new staff as they are 
hired, and assist with implementation support. 
Each participant receives a comprehensive 
trainer’s manual, CD-ROM, and a set of four 
staff training videos. 

Professional development credits are available for 
completion of the regional Second Step Training 
for Trainers. (This training is available both 
regionally and onsite.) 
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Promoting Alternative Thinking Strategies 


Intervention Description 


Background 

Promoting Alternative Thinking Strategies 
(PATHS) is a universal prevention program that 
was developed by Carol Kusche, Pli.D., of the 
University of Washington and Mark Greenberg, 
Ph.D. of Pennsylvania State University. 

This program is an elementary school-based (K-5) 
program that is delivered by the teachers to reduce 
and prevent emotional and behavioral problems. 
PATHS is delivered by national certified 
trainers through PATHS, LLC, based in Seattle, 
Washington. Since 2000, it has been disseminated 
to approximately 80,000 students in the United 
States, Switzerland, UK, The Netherlands, Germany, 
Belgium, Greece, Australia, Mexico, and South 
America. More than 200 organizations are receiving 
some type of PATHS services at any given time 
(M. Greenberg, personal communication, September 
28, 2006). 


Characteristics of the intervention 

PATHS is a 5-year program that is implemented 
in the schools by teachers and counselors. The 
program is aimed at students who are either in 
mainstream or special education classes. The goal 
of the program is to increase social and emotional 
competencies while reducing aggressive, acting- 
out behaviors. 


It is recommended that sites hire a PATHS 
coordinator to assist with implementation and 
help to ensure its quality. A coordinator should 
have a background in teaching with a solid foundation 
and experience in social and emotional learning. 


Figure 4 


Promoting Alternative Thinking Strategies 

Type of EBP 

■ Prevention 

Setting 

■ School-based (including 
alternative schools and charter 
school programs) 

Age 

■ 5-12 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Increase in ability to label 
feelings. 

■ Increases in self-control. 

■ Reductions in classroom 
aggression. 

■ Decrease in teacher-reported 
internalizing and externalizing 
negative behaviors. 


PATHS is delivered by trained teachers three 
times a week for approximately 20 to 30 minutes. 
A manual is available with specific instructions 
and developmentally appropriate lessons that 
address five major domains: self-control; 
emotional understanding; positive self-esteem; 
relationships; and interpersonal problem-solving 
skills (Greenberg, Kusche, & Mihalic, 1998). 
Each domain has subgoals according to the 
developmental level of each child. 
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The PATHS program is delivered in developmental^ 
tailored lessons by teachers using a variety of 
teaching methods. The curriculum consists of 
an instructional manual, six volumes of lessons, 
pictures, photographs, posters, Feeling Faces, and 
additional material. There are three major units: 

■ The Readiness and Self Control Unit 
(12 lessons); 

■ The Feelings and Relationships Unit 
(56 lessons); and 

■ The Interpersonal Cognitive Problem-Solving 
Unit (33 lessons). 

A Supplementary Unit covers issues in friendship 
and moral decisionmaking and reviews lessons in 
the other units. The large instructional manual 
provides the scope and sequencing of the lessons 
for each developmental group. Younger children 
are exposed to the Turtle Unit (Readiness and 
Self-Control), which teaches readiness and self- 
control through metaphorical storytelling and 
behavioral support. 

For children in the latter elementary years, a more 
cognitively advanced approach has a greater focus 
on problem-solving tasks and lessons. Flexibility 
exists in the program to allow teachers to tailor 
the lessons to their individual teaching style. 


Research Base and Outcomes 

Research on the effects of PATHS has been 
conducted since 1983, including five randomized 
control designs. Studies have examined the 
effectiveness of the program in real world settings, 
in samples of regular and special education 
classrooms, and with culturally diverse students 
that include African Americans, Hispanics, 
American Indians, and Asian Americans. Riggs 
(2006) specifically studied the effects of PATHS 
administered as a part of an after-school program 
with rural Latino children. 

Research supports many positive outcomes of the 
PATHS intervention, such as reducing classroom 
aggression, internalizing problems, self-reporting 
depressive symptoms, and increasing developmental 
understanding of, and fluency with, discussing 
emotional experiences. Positive outcomes have 
been noted in both 1- and 2-year followup studies. 
See Table 4. 
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Table 4: Promoting Alternative Thinking Strategies: Research Base and Outcomes 


Reference Research Design and Sample* 

Randomized design with 30 classrooms of children (n = 286, grades 2-3) 
randomly assigned to be exposed to the PATHS curriculum or the control 
group to measure the effects of the intervention on a child's emotional 
understanding. 

Pre-post test measures and interview questions used to test children's 
understanding of emotional situations. 

Study population: 

■ 58% Male 

■ 42% Female 

■ 58% White 

■ 32% African American 

■ 4% Asian American 

■ 2.5% Filipino Americans 

■ 2.5% American Indians 

■ 1% Hispanic 

Randomized control design (n = 378), 198 1 st grade classrooms assigned 
to treatment group (the PATHS intervention) and 180 assigned to the 
control group; all from high-crime neighborhoods. 

Study population: 

■ Mean percentage of minority students (primarily African American) 
across all 378 schools was 49%. The range was from 1% to 90%. 

Kam, Greenberg, Experimental research design examining the long-term effects of the 
& Kusche (2004) PATHS curriculum on the adjustment of school-age children receiving 
special education services. 

Special education classrooms (n = 18) were randomly assigned to the 
control group (no PATHS- intervention) or the treatment group (PATHS- 
intervention). Children (n = 133) grades 1 st—3rd at start. Data collected 
for 3-successive years. 

Study population: 

■ 73% Male 

■ 27% Female 

■ 66% White 

■ 20% African American 

■ 1 4% Other 

Randomized design studied the PATHS curriculum on 30 classrooms with 
318 children, grades 2-3, to measure 1-year post-intervention outcomes 
on teacher-reported externalizing and internalizing behavioral problems, 
as well as mediation through tasks assessing executive functions. 

Study population: 

■ 50% Male 

■ 50% Female 

■ 55% White 

■ 33% African American 

■ 22% Asian American, American Indian or other racial background 

Domitrivich, Cortes, Randomized design studied PATHS curriculum with children (grades K—6) 
& Greenberg (2007) from 20 classrooms (n = 246). 10 classrooms received PATHS curriculum; 
10 were control classrooms. 

Study population: 

■ 49% Male 

■ 51% Female 

■ 38% White 

■ 47% African American 

■ 10% Hispanic 

■ 5% Other racial background 


Riggs, Greenberg, 
Kusche, & Pentz 
(2006) 


Greenberg, Kusche, 
Cook, & Quamma 
(1995) 


The Conduct 
Problems 

Prevention Research 
Group (1999) 


Outcomes 

Children exposed to PATHS demonstrated increased 
range of affective vocabulary and fluency in 
discussing emotional experiences, beliefs regarding 
management of emotions, and developmental 
understanding of some aspects of emotions. 


After 1 year, children exposed to PATHS demonstrated 
reductions in classroom aggression and increases 
in self-control. 


For special education children, the PATHS intervention 
indicated reduced growth of internalizing and 
externalizing negative behaviors by teacher reports 
at 2 years after intervention. 

Additionally, PATHS intervention produced sustained 
reduction in child-reported depressive symptoms. 


Results showed significant effects at posttest on 
children's inhibitory control and verbal fluency. 

Findings 1 year later showed significant teacher 
effects on students' externalizing and internalizing 
problems. 


After exposure to PATHS, children in the PATHS 
classrooms had higher emotion knowledge skills 
and received higher ratings from parents and teachers 
for social competency than children in the control 
classrooms. 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure Issues 
Readiness: 

No formal readiness instruments are available. 
An informal assessment process is conducted 
with an interested site and the PATHS trainers. 


Training/coaching and materials 

■ Training is provided through PATHS 
Training, LLC. 

■ Training new sites requires a 2- to 3-day 
onsite visit, which involves teachers, school 
administrators, and on occasion, parents. 

■ Ongoing technical assistance and coaching 
usually consist of weekly or biweekly 
observations by curriculum consultants. These 
booster sessions can be individualized to the 
site. They can also last up to 4 to 5 years after 
initial implementation of PATHS. In subsequent 
years of PATHS implementation, teachers will 
receive a half-day of training. 

■ Whole school staff discussions occur quarterly. 

■ Trainer certification is available through 
PATHS Training, LLC. This certification 
requires working as a local PATHS coordinator 
and demonstrating leadership in assisting sites 
in implementing PATHS locally. This process 
will last 2 years, before advancing to intensive 
training. Fifteen trainers are in the United States. 


■ Materials available for purchase: 

□ Complete PATHS curriculum 
(includes readiness curriculum) ($679); 

□ PATHS Basic Kit ($579); 

□ PATHS Readiness and Self-Control 
Turtle Kit ($159); and 

□ Costs of additional materials ($100). 

■ Parent materials are available in Spanish. 

Information about the curriculum can be obtained 

at: http://www.prevention.psu.edu/projects/ 
PATHSCurriculum.html 

Information about purchasing the curriculum 
can be obtained at: http://www.channing-bete.com/ 
prevention-programs/paths/. 


Cost of training/consulting 

■ Complete training and ongoing technical 
assistance costs are approximately $4,000 
to $5,000 plus travel and per diem expenses 
for 1 trainer, 2 days, and 30 participants. 

■ For onsite training only (for 2 days and up 
to 30 participants), costs are approximately 
$3,000 plus travel and per diem expenses 
for the trainer. 

■ The developers project that the cost to 
implement PATHS is approximately $25 
per student. Total costs including training 
and technical assistance for first year 
operations at an elementary school are 
around $10,000. In the following year, the 
costs would decrease to about $10 per student. 
Thus, the cost to implement the program over 
3 years is approximately $15 per student. 

These costs do include some training materials, 
as outlined previously. 
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Developer involvement 

The developers, Dr. Greenberg and Dr. Kusche, 
are actively involved in developing and modifying 
the program. However, PATHS, LLC, based in 
Seattle, is responsible for assessing interested 
parties in the PATHS program, assigning trainers, 
and managing the training process. 

MarkT. Greenberg, Ph.D. 

Director, Prevention Research Center 
Henderson South - 112 
Pennsylvania State University 
University Park, PA 16803 
Phone: (814) 863-0112 
Fax: (814) 865-2530 
Email: mxg47@psu.edu 

Carol A. Kusche, Ph.D. 

PATHS, LLC 
927 10th Avenue East 
Seattle, WA 98102 
Phone: (206) 323-6688 
Email: ckusche@attglobal.net 


Monitoring fidelity and outcomes 

■ Fidelity measures are available for sites to 
use. For some sites that are participating in 
a research study, the fidelity measures are 
required and sent monthly to PATHS, LLC. 
However, sites that are not a part of a study are 
not required to collect or report fidelity measures. 

■ Both fidelity and teacher-reported outcome 
measures are available at no charge from the 
publisher (Channing-Bete, Inc). Sites are 
advised to collect and report their outcome 
measures. PATHS, LLC does offer support to 
sites interested in using outcome data to better 
inform program decisionmaking. 


Financing the intervention 

■ Most schools use Safe & Drug-Free school 
funds, school board funds, and short-term 
grants from local and federal agencies. 

■ The program is not covered by Medicaid 
(M. Greenberg, personal communication, 
September 28, 2006). 
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Resources/Links: 

To order PATHS materials, go to: 

http://www.channing-bete.com/prevention-programs/ 

paths/paths.html 

University of Colorado’s Center for the Study 
and Prevention of Violence: 

http://www.colorado.edu/cspv/ 
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First Steps to Success 


Intervention Description 


Background 

First Steps to Success was developed in the early 
1990s by Hill M. Walker, Pli.D., and his colleagues 
at the University of Oregon. This school-based 
program with home components is for kindergarten 
children who display early signs of aggression, 
oppositional behavior, and severe temper tantrums. 


Coaches have a critical role in the program: 

■ Working in the classroom; 

■ Gaining parent and guardian’s support; 

■ Monitoring the program during the teacher 
component; 

■ Assisting parents and guardians in mastering 
the program; and 

■ Troubleshooting for the entire duration 
of the program. 


The goal is to divert future antisocial behavior. 
Within the past 2 years, more than 20 organizations, 
and between 1,500 and 2,000 practitioners have 
been trained to deliver First Steps to Success. 


Characteristics of the intervention 

The program comprises three interconnected 
components and is implemented in 3 to 4 months. 
First Steps to Success is designed for children with 
challenging behaviors, aggression, and acting out, 
and who victimize others in the school environment. 

Coaches are trained to work with two to three 
students who coordinate the school and home 
components. Staff members who implement the 
program should possess a master’s degree and have 
clinical experience. 


Coaches will work alongside the teacher and 
parent to provide them with skills to identify the 
maladaptive behavior and reward good behavior. 


Figure 5 


First Steps to Success 

Type of EBP 

■ Prevention/Multi-level 

Setting 

■ Home 

■ School 

Age 

■ 5-6 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Decrease in aggression 

■ Increase time spent on 
academics 

■ More positive behavior 
demonstration. 
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The three interconnected modules of First Steps 
to Success are as follows: 

1. Screening: A range of methods are used to 
assess kindergarteners, from teacher-reports 
to direct observation. 

2. School intervention: This component focuses on 
the child’s behavior in school using a contingency 
reward system. A consultant initially works with 
the student closely in the classroom, offering 
direct feedback using color cards to identify 
behavior. Children work toward a reward by 
demonstrating positive behavior. 

3. Home intervention: The home-based model 
focuses on helping parents and caregivers 
support the child’s progress. Six skills are 
practiced in the home to help the children 
succeed in the school environment: 

■ Communication and sharing; 

■ Cooperation; 

■ Limit setting; 

■ Problem solving; 

■ Friendship making; and 

■ Developing confidence. 


Research Base and Outcomes 

The research base for the First Step to Success 
program includes one experimental waitlist control 
group design, one replication study with a pre-post 
test design, a multiple case study design, a program 
evaluation, and a multiple-baseline across groups 
design with qualitative interviews as displayed in 
the table below. 

Students and families from culturally diverse 
backgrounds were used in the studies: Flispanic, 
African American, and American Indian. The 
research points to a number of positive changes in 
the behavior of children identified to be at risk of 
developing a serious pattern of antisocial behavior. 

Research also finds that when the program is 
implemented in kindergarten, positive behavior 
changes are maintained through 1st and 2nd grade. 
See Table 5. 
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Table 5: First Steps to Success: Research Base and Outcomes 


Reference 

Research Design and Sample* 

Outcomes 

Walker, Kavanagh, 
Stiller, Golly, 
Severson, & Feil 
(1998) 

Randomized experimental waitlist control group cohort design of children 
in kindergarten (n = 46) identified as at risk for developing serious 
patterns of antisocial behavior, randomly assigned into one of two control 
groups (no First Steps to Success Intervention) or one of two intervention 
groups (First Steps to Success Intervention). Children assessed for reduction 
of aggression and improvement in using new prosocial behaviors. 

Data collected at pretest, posttest and 1st grade followup and 2nd 
grade followup. 

Study population: 

■ 74% Male 

■ 26% Female 

■ 93% White 

■ 7% Children of minority status 

Children who participated in the First Steps to 

Success program showed significantly more adaptive 
behavior, less aggression, and less maladaptive 
behavior. Children who received First Steps to 

Success demonstrated more engagement in 
schooling activities. 

Results were similar at the 1st grade and 2nd 
grade followup. 

Golly, Stiller, & 
Walker (1998) 

Pre-post test design replication research study (n = 20) of kindergarten- 
aged children identified to have high aggression ratings, low-adaptive 
behavior ratings, high-maladaptive behavior ratings. Limitations include 
a lack of a control group. 

Study population: 

■ 95% Male 

■ 5% Female 

■ 95% White 

■ 5% American Indian 

Outcomes in the replication study were similar 
to the original study. 

First Steps to Success program showed significantly 
more adaptive behavior, less aggression, and less 
maladaptive behavior. 

Overton, McKenzie, 
King, & Osborne 
(2002) 

Multiple case study (n = 16) using semistructured parent and teacher 
interviews. 

Study population: 

■ 73% Male 

■ 27% Female 

■ 23% White 

■ 32% African American 

■ 23% White and African American 

■ 4% Hispanic 

■ 14% American Indian 

■ 4% American Indian and White 

Behavioral improvements as evidenced by increases 
of the Child Behavior Checklist were significant, 
but variable. Reports from semistructured interviews 
with parents/caregivers and teachers were 
generally positive. 

Walker, Golly, 
McLane, Kimmich 
(2005) 

Program evaluation of the implementation of First Steps to Success 

Program to focus on children grades K-2, (n = 181). 

Results closely replicated the original study for 
behavioral outcomes for students. Evaluators 
found satisfaction from teachers and parents. 

Fidelity varied widely. 

Diken & Rutherford 
(2005) 

A multiple-baseline across groups design with qualitative interviews with 
American Indian students (n = 4, 2 at kindergarten level, 2 at 1st grade 
level). Outcome measures of direct observations and teacher and parent 
interviews. 

Study population: 

■ 75% Male 

■ 25% Female 

■ 100% American Indian 

Students' social play behaviors significantly increased 
when First Steps to Success intervention initiated. 

Substantial decreases in problem behaviors reported 
by teachers. 

Three of the 4 parents reported significant changes 
in problem behaviors of students. 

Parents reported high satisfaction with the program. 


* Study sample's gender and race/ethnicity data provided when available. 
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Dr. Walker and colleagues are researching the 
implementation of First Steps to Success through 
two large grants from the Institute of Education 
Sciences within the U.S. Department of Education. 
Both studies are randomized control trials with 
a year-long followup of experimental and control 
condition participants. One is an efficacy trial 
in Albuquerque, New Mexico; the other is an 
effectiveness trial involving five sites nationally 
(H. Walker, personal communication, June 6, 2007.) 


Implementation and Dissemination 


Training/coaching and materials 

■ Five expert trainers are available to provide 
training to sites. The coaches participate in a 
2-day training to learn about the program and 
the implementation sequence. The teachers 
participate in a 1-day training to learn about 
their responsibilities. The training structure 
incorporates didactic teaching, role plays, 
and question/answer demonstration. 

■ A manual is provided to the site once training 
and implementation begin. The training 
materials have been translated in Spanish, 
French, and Japanese. 

■ Information on purchasing the curriculum can 
be obtained at: http://store.cambiumlearning.com 


Cost of training/consulting 

The cost of training up to 30 coaches and 50 
teachers is $1,000 to $1,500 per day plus the cost 
of the materials, training, and airfare (H. Walker, 
personal communication, June 6, 2007). 


Developer involvement 

The developer, Dr. Walker, is actively involved in 
developing and modifying the program, providing 
coaching/teacher training and followup technical 
assistance. Information about training can be 
obtained by contacting the developer: 

Hill M. Walker, Ph.D. 

Institute on Violence and Destructive Behavior 

1265 University of Oregon 

Eugene, OR 97403 

hmwalker@uoregon.edu 

Phone: (541) 346-2583 

Fax: (541) 346-2594 


Monitoring fidelity and outcomes 

Instruments for measuring fidelity of critical 
program features and the quality of the 
implementation are available. Coaches are 
required to complete program implementation¬ 
monitoring forms that document application and 
quality of the procedures (H. Walker, personal 
communication, June 6, 2007). Outcome measures 
are collected from designated research sites but 
not from nonresearch sites. 


Financing the intervention 

The program is usually funded through local school 
district, state, and federal government budgets (H. 
Walker, personal communication, August 30, 2006). 
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Resources/Links 

■ Office of Juvenile Justice and Prevention 
Program: http://www.ojjdp.gov/MPG 

■ Sopris West Educational Services (to order 
materials): http://www.sopriswest.com. 

■ University of Oregon’s Institute on Violence 
and Destructive Behavior: 

http://www.uoregon.edu/~ivdb. 
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Early Risers: Skills for Success 


Intervention Description 


Background 

The Early Risers: Skills for Success program 
is a multicomponent, competency skill-based 
intervention designed for children ages 6 to 12 
years who display, or are at risk of displaying, 
conduct-related problems and substance use. 

The Early Risers program was developed by 
Gerald August, Pli.D., George Realmuto, M.D., 
and Michael Bloomquist, Pli.D., at the Center 
for Prevention and Children’s Mental Health 
at the University of Minnesota. The program has 
been in existence since 1996 and has evolved from 
a school-based to a community-based prevention 
and intervention program. 

The program has been implemented in more 
than 30 organizations within the past 4 to 5 years 
(G. August, personal communication, July 17, 2006). 


Characteristics of the intervention 

The Early Risers program provides comprehensive 
mental health promotion services to early elementary 
school-age children displaying early onset aggressive, 
disruptive, and socially withdrawn behaviors and to 
their families. The intervention model is grounded 
in social learning, social cognition, and social 
bonding theoretical perspectives. 

The model features child-focused and family- 
focused components, each of which offers skill¬ 
building and support services delivered in unison 
over time. The Early Risers program involves 
collaboration between community public schools, 
community agencies, and University of Minnesota 
prevention specialists. 


Figure 6 


Early Risers: Skills for Success 

Type of EBP 

■ Prevention 

Setting 

■ Home 

■ School 

Age 

■ 6-12 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Gains in academic achievement. 

■ Reduction in self-regulation 
problems. 

■ Improved social skills and 
adaptability. 


The program unfolds over 2 to 3 years and 
emphasizes four domains: 

■ Child academic competence; 

■ Child behavioral self-regulation; 

■ Child social-emotional competence; and 

■ Parent investment (August, Realmuto, Hektner, 
& Bloomquist, 2001). 

Children are identified in early elementary grades 
through teacher nomination and standardized 
teachers’ ratings of child behavior. The 
intervention is delivered by a “family advocate” 
who is usually a bachelor-degreed professional with 
at least 2 years’ experience working with children 
and families. 

To effectively deliver services, the family advocate 
must have the flexibility to work unconventional 
hours and be willing to visit families and children 
in multiple settings, such as home, school, or 
community (G. August, personal communication, 
July 17, 2006). 

The family advocate coordinates services for both 
the child-focused and family-focused components. 
The child-focused component consists of a set of 


Evidence-Based and Promising Practices 


37 
















education/skills training and support interventions 
for children. Child-focused interventions include 
the following: 

■ Summer Day Camp (standardized): This interaction 
is designed for delivery during the summer 
months. It works best when offered 4 days per 
week for 6 weeks. Implementers are required 
to offer three 1-hour curricula each day: social- 
emotional skills education and training, reading 
enrichment and appreciation, and creative arts 
experiences. A behavioral management protocol 
is administered throughout all activities. 

■ School Year Friendship Groups (standardized): 

Children are invited to attend small group 
sessions before, during, or after school. This 
program provides advancement of social- 
emotional skills education and training, reading 
enrichment and appreciation, and creative arts 
experiences. A behavioral management protocol 
is administered throughout all activities. 

■ Monitoring and Mentoring School Support 
(tailored): This feature occurs throughout each 
school year and is intended to help and modify 
academic instruction as well as address children’s 
behavior while in school, through the support of 
the family advocate. In addition, a primary goal 
is to bridge family and school to foster continued 
success in learning. A home reading program is 
such a bridge. 

The goal of the family-focused component is to 
empower families and to allocate the appropriate 
resources to help families reach their identified 
goals. Family-focused interventions include 
the following: 


■ Family Nights with Parent Education 
(standardized): Children and parents come to 

a center or school during the evening. Children 
participate in fun activities while their parents 
meet in small groups for 60 minutes of parent- 
focused education and skills training designed 
to enhance parent’s knowledge of child 
development and parenting skills. This is 
followed by parent-child “bonding” activities. 
Family Nights occur five times during the 
school year between October and May. 

■ Family Support (tailored): This program is 
individually designed to address each family’s 
specific needs, strengths, and maladaptive 
patterns. It is delivered in four phases: 

□ Asset appraisal and needs assessment; 

□ Goal setting; 

□ Brief interventions and resources; and 

□ Monitoring and reformulating goals. 

In addition, if indicated, more intensive and 
tailored parent skills training is provided. 


Research Base and Outcomes 

The evaluation of the Early Risers program 
includes an initial efficacy study, an early-stage 
effectiveness trial, and an advanced-stage 
effectiveness trial, all with randomized control 
designs. See Table 6. The initial study was 
conducted with a semi-rural. White sample, while 
the validation study was conducted with a mostly 
African American, urban sample. 

Overall, research supports significant relationships 
between children’s level of participation throughout 
the Early Risers program (more than 1 year or 
more) and social competence, school adjustment, 
and academic achievement. August et ah, (2004; 
2006) point to the need for longer durations of 
interventions or booster sessions to maintain positive 
results, as well as the concern for attrition rates. 
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Table 6: Early Riser: Research Base and Outcomes 


Reference Research Design and Sample* 

Outcomes 


August, Realmuto, 
Hektner, & 
Bloomquist (2001) 

August, Hektner, 
Egan, Realmuto, & 
Bloomquist (2002) 

August, Egan, 
Hektner, & 
Realmuto (2003) 

Bernat, August, 
Hektner, & 
Bloomquist (2007) 


Efficacy Study: Randomized, controlled design of, children (n = 245) 
rated high risk by the Child Behavior Checklist - Teacher Rating form; 
124 children at intervention schools and 121 children at control schools. 

Data are published for 2- and 3-year immediate intervention effects, 
and followup at Year 4 and Year 6. 

Study population: 

■ White families 


For intervention schools, the most severely aggressive 
children improved behavior at Years 2 and 3. 

Children improved on indicators of school achievement 
at Years 2 and 3. 

Program children evidenced better social adjustment 
at Year 3, and did better on a sociometric assessment 
of social status at Year 4 (less rejected and more 
accepted by prosocial peers). 

Parents with high program participation showed 
improvements in self-reported discipline methods 
at Years 2 and 3. 

Program children and their parents reported 
significantly fewer ODD symptoms at Year 6. 

Fewer ODD symptoms for program children at Year 6 
were related to previous Year 3 improvements in child 
social skills and parent effective discipline practices 
(that is, mediational analyses). 


August, Lee, Early-Stage Effectiveness Trial: Randomized, controlled design (n = 327), 

Bloomquist, kindergarten and 1st grade children from 10 low socioeconomic schools 

Realmuto, & screened positive for aggressive behavior. 

Hektner (2003) y w0 y ears 0 f continuous active intervention and 1 year of no formal 

August, Lee, intervention. Three groups: the full Early Risers program (child- and 

Bloomquist, family-focused), partial Early Risers (child-focused only), and no 

Realmuto, & intervention (control group). 

Hektner (2004) Because initial analysis comparing experimental groups showed no 

significant differences between groups on any outcome variables, the full 
Early Risers program and partial Early Risers Program were collapsed and 
compared as an augmented group to the control group. 

Data are published for two immediate intervention effects and followup 
at Year 3. 

Study population: 

■ 80% African American 

■ 20% White 


Program children exhibited significant gains 
on measures of school adjustment and social 
competence. 

The most aggressive program children showed 
reductions in disruptive behavior. 

Program children's parents reported lower levels 
of stress. 

Program children maintained social competence 
gains at Year 3. 

School adjustment improvements and externalizing 
problems were not maintained at Year 3. 


August, Bloomquist, 
Lee, Realmuto, & 
Hektner (2006) 


Advanced-Stage Effectiveness Trial: 

Randomized, controlled design (n = 295), kindergarten and 1st grade 
children from 16 low socioeconomic schools with 2/3 of the population 
exhibiting a positive screen for aggressive behavior. 

Two years of continuous active intervention. In this initiative, a 
community agency assumed "ownership" of the program by funding it 
and its staff implemented all components with only technical assistance 
from program developers. 

The Early Risers program and a no intervention control group were 
compared. Data are published for 2-year immediate intervention effects. 

Study population: 

■ 69% Male 

■ 31% Female 

■ 89% White 

■ 11% Minority 


Overall attendance rates were poor and this was 
attributed to the community agency insufficiently 
allocating resources to engaging families (for example, 
limited funding of transportation, agency downsizing, 
and high staff turnover). 

Although program children exhibited significant gains 
on teacher's ratings of disruptive behavior, no other 
previous findings were replicated. 

Dosage analysis, however, determined that program 
children who did attend at acceptable levels exhibited 
gains on indicators of social and academic competence, 
and a math achievement test. 

It was concluded that attention to family engagement 
and adequate resource allocation is essential to obtain 
positive program effects. 


’ Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 
Readiness: 

The program provides a checklist used to screen 
and assess the capacity of the interested parties, 
and determine if Early Risers would be appropriate. 
For those sites that might not be best suited for the 
Early Risers program, the developers attempt to 
recommend a more “compatible” program. 

For those sites that are appropriate, it may take 3 
to 6 months to start the program due to recruitment 
and screening. 

Possible barriers: 

Some barriers to the implementation 
and sustainability are as follows: 

■ Funding problems; 

■ Turnover of key personnel; and 

■ Loss of a key staff member to ensure 
quality implementation and sustainability 
of the program. 


Training/coaching and materials 

■ The training program is usually held over a 
4-day period at the designated host site. About 
20 family advocates and program supervisors 
can participate in the training at once. 

■ A Skills for Success training manual, video, and 
other programmatic resources are available for 
an additional charge. 

■ The developers maintain an ongoing 
relationship with a site for up to 2 years. 

■ The Early Risers Program is affiliated 
with the University of Minnesota. 

■ Information about training and materials can 
be obtained at: http://www.psychiatry.umn.edu/ 
research/earlyrisers/home.html 


Cost of training/consulting 

The overall training, technical assistance, and 
supportive services costs range from $5,000 to 
$8,000. The cost to implement the Early Risers 
program is about $1,500 per child, per year. 


Developer involvement 

Currently, the developers are still very involved 
in implementing and disseminating Early Risers. 
For more information, contact Dr. August. 

Gerald J. August, Ph.D. 

Division of Child and Adolescent Psychiatry 

University of Minnesota 

2450 Riverside Avenue, F256/2B West 

Minneapolis, MN 55454-1495 

Phone: (612) 273-971 1 

Fax: (612) 273-9779 

augus001@umn.edu 


Monitoring fidelity and outcomes 

The fidelity of program delivery (that is, exposure, 
adherence, quality) is monitored throughout. 
Information is systematically collected and 
reviewed by the university prevention specialists, 
community agency supervisory staff, and family 
advocates. This includes examination of child 
and parent attendance, documentation of services 
provided, direct observation of intervention 
provision, and consumer satisfaction data. 
Adjustments in programming, staffing, and 
training are made based on fidelity monitoring. 

At this present time, the developers of the program 
are completing the development of a web-based 
fidelity monitoring system. This system is being 
designed as a self-report mechanism offering 
background information (number of children 
and families served), how the program was 
delivered, and the methods used. A family 
advocate is to log-on once a week to offer this 
information. This is not a specific requirement, 
but is strongly encouraged. 
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The developers assist sites with collecting and 
interpreting outcome data. Part of the training 
focuses on identifying someone at the site who 
will collect this data. 


Financing the intervention 

Early Risers is typically paid for by local grant 
money (G. August, personal communication, July 
17, 2006) or through access to local county dollars 
earmarked for prevention (Bloomquist et al., 2006). 


Resources/Links 

University of Minnesota-Department of Psychiatry: 

http://www.psychiatry.umn.edu/research/earlyrisers/ 

home.html 
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Adolescent Transitions Program 


Brief Description 


Background 

The Adolescent Transitions Program (ATP) 
developed by Thomas Dishion, Pli.D., and Kate 
Kavanagh, Pli.D., is a multilevel, family-centered 
intervention that seeks to prevent teen antisocial 
behavior and drug experimentation. ATP was 
designed as a group psychoeducational intervention 
focused on family management practices and 
reducing deviant peer influences; it was offered 
to high-risk adolescents and families in an 
outpatient setting. 

Continued research by developers led to a 
significant growth of the program, including 
implementation in the middle school setting and 
offering levels of the intervention that permeate 
the entire school environment (Dishion & 
Kavanagh, 2003). 

Today, ATP is a three-tiered intervention that has 
both parent and child curricula delivered in both 
group and individual formats. The parent curriculum 
focuses on understanding family dynamics and 
effective parent management skills through 
encouragement, limit setting and supervision, 
problem solving, and communication patterns. 

The child curriculum focuses on a social learning 
approach to behavior change through limit setting, 
problem solving, goal setting, outlining the 
appropriate steps to achieve goals, and developing 
peer support for prosocial behavior (Dishion & 
Kavanagh, 2003). 


Figure 7 


Adolescent Transitions Program 

Type of EBP 

■ Prevention/Multilevel 

Setting 

■ School 

Age 

■ 11-18 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Reduction in negative parent- 
child interactions. 

■ Decrease in antisocial behaviors 

at school. 

■ Effective in reducing youth 
smoking. 


Characteristics of the intervention 

There are three levels of the ATP intervention: 
universal, selective, and indicated. 

Level 1: Universal 

The first level is aimed at the entire school 
population. A main component is the development 
of a Family Resource Center (FRC) within the 
school; a full-time coordinator is hired as a school 
employee to operate the center. 

The goals of the FRC include: 

■ Encouraging referrals of at-risk students 
and families; 

■ Providing parents information about services; 

■ Disseminating information about parenting; and 

■ Working with school and community 
professionals on topics of identification 
and effective treatment of at-risk students 
(Dishion & Kavanagh, 2003). 
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Formats for disseminating information to parents 
include the following: 

■ School orientation meetings; 

■ Media on effective parenting and norms; 

■ Classroom-based parent-child exercises that 
support family management practices; and 

■ Phone calls and letters to parents about their 
child’s activities at school. 

The format for disseminating information to 
students is the Success Health and Peace (SHAPe) 
curriculum: 6 sessions, 40 to 60 minutes each, 
delivered weekly in health class or homeroom, 
implemented by teachers, yet supported and 
coordinated by FRC staff. 

Level 2: Selective 

The second level of the intervention provides 
selective assessment, identification, and professional 
support for at-risk children and their families 
through the administration of the Family Check-Up 
(FCU). The three-session intervention is designed 
to gather information about the family to develop 
a plan to support the well-being of the child 
and family. 

■ Session 1: The initial family interview is 90 
minutes in length and includes two therapists, 
the parents, and the adolescent. The Family 
Intake Questionnaire-Adolescent Version is 
used to gain background information. 

■ Session 2: The comprehensive assessment of the 
family includes a videotaped session to measure 
family management practices and the completion 
of a Family Assessment Task. 

■ Session 3: The family feedback session is aimed 
at encouraging family engagement in the ATP 
process, the maintenance of positive family 
practices, as well as making changes in parenting 
problems (Dishion & Kavanagh, 2003). 


Level 3: Indicated 

The third level of the intervention is direct support 
focused on parents to help change clinically 
significant problems through a variety of services 
identified collectively as The Family Intervention 
Menu. Services, administered by masters-level 
clinicians known as “Group Leaders,” include 
the following: 

■ Family Management Group: A 12-week group 
with 8 to 10 families using exercises, roleplays, 
videotapes, and booster sessions available 
monthly at the conclusion of groups for at 
least 3 months. A parent consultant who has 
completed the program can help guide the 
group’s conversation and can be a bridge 
between parents and group leaders. 

■ A home-school card 

■ One to two sessions on special topics from 
the Family Management Curriculum 

■ Monthly monitoring 

■ Individual Family Management Therapy 
from the Family Management Curriculum 

■ Referrals to more intensive services 


Research Base and Outcomes 

ATP research studies include randomized clinical 
trials as well as replication studies. The research 
supports the intervention in successfully reducing 
adolescent problem behaviors of substance use 
as well as increasing family communication and 
relationships. Research participants include 
American Indians, African Americans, Asian 
Americans, and Latinos. Specific outcomes 
from ATP studies are outlined in Table 7. 
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Table 7: Adolescent Transition Program: Research Base and Outcomes 


Reference Research Design and Sample* 


Dishion & Andrews 
(1995); 

Dishion et al., 
(1996) (in Dishion 
& Kavanagh, 2003) 


Level 3 Research Study: 

Total n = 158 families with high-risk young adolescents (ages 11-14) 
in a randomized clinical trial (n = 119) assigned to one of four group 
intervention conditions 

1) Family Management Curriculum (FMC) with parent focus, 

2) FMC adolescent focus, 

3) FMC parent & adolescent focus, 

4) self-directed change (materials only). 

Intervention lasted 12 weeks. An additional n = 39 families of young 
adolescents were recruited as a quasi-experimental control. Followup 
at 1 year. 

Study population: 

■ 52.5% Male 


■ 47.5% Female 

■ 95% White 


Irvine, Biglan, 
Metzler, Smolkowski, 
& Ary (1999) 


Replication Study of Level 3 Research: 

Randomized clinical trial with high-risk rural families (n = 303) assigned 
to parent-focused FMC intervention group or a waitlist control group. 
Study population: 

■ 61% Male 

■ 39% Female 

■ 88% White 

■ 3% American Indian 

■ 2% Hispanic 

■ 7% Other 


Outcomes 

Both Family Management Curriculum (FMC) and 
self-regulation were associated with reduction in 
negative engagement between parent and child. 

Teachers reported less antisocial behaviors for 
youth in FMC groups. 

Interventions with aggregated high-risk youth 
showed escalations in tobacco use and problem 
behavior at school, beginning at termination 
and persisting to followup when compared to 
control group. 

Parent-only condition nearly eliminated onset 
of youth smoking at 1 year, yet results faded after 
1 year. 


For the intervention group: 

Improvements in problem- solving interactions. 
Parents' overactivity and lax approach to child's 
behavior reduced. 

Parent's positive feelings toward child improved. 

Parent-reported antisocial behaviors 
decreased significantly. 

Measures of child adjustment improved. 


Dishion, Kavanagh, 
Schneiger, Nelson, 
& Kaufman (2002); 

Dishion, Nelson, 

& Kavanagh (2003) 


Multilevel Research Study 

4-year longitudinal study of multiethnic 6th grade students (n = 672) and 
their families randomly assigned to ATP intervention or to control condition. 
Study population: 

■ 52% Male 


■ 48% Female 


■ 41% White 


■ 32% African American 


Intervention reduced initiation of substance use 
in both at-risk students and those not at risk. 
Families assigned to the Family Check Up 
(FCU) intervention maintained positive parental 
monitoring practices; parents of high-risk 
adolescents decreased parental monitoring from 
grades 7 to 9. 

Prevention effect of the FCU on substance abuse 
was mediated by changes in parental monitoring. 


■ 7% Hispanic 

■ 6% Asian American 


■ 2% American Indian 


Level 2 Research Study 

Within the context of the above study, high-risk youth and families (n = 71) 
selected for either Family Check Up (FCU) intervention (n = 35) or to the 
control group (no FCU) (n = 36). 

Study population: 

■ 39% Male 


■ 61% Female 


■ 32% White 

■ 51 % African American 

■ 14% Multiethnic 


■ 3% Hispanic 


* Study sample's gender and race/ethnicity data provided when available. 


Evidence-Based and Promising Practices 


45 










Possible barriers: 


Implementation and Dissemination 


Infrastructure issues 

As indicated by Dishion (personal communication, 

September 13, 2006): 

Readiness: 

■ On average, it takes 6 months from the initial 
contact with trainers for school staff training 
to begin. 

■ Top performance sites have strong leadership 
and organization that supports a culture of 
fidelity where professionals working with 
families are enthusiastic about having Family 
Management Groups taped and then examined 
to improve their work. 

■ Careful selection and training of staff is critical 
to the success of the program. 

■ It is advantageous for sites to secure state 
funding and school district support before 
implementing the program. 

Facilitators: 

According to Dishion & Kavanagh (2003): 

■ School administration facilitates the 
implementation of the program by rewarding 
effective group leaders and parent consultants. 

■ For a successful program, the school staff should 
value and support the Family Resource Center. 

■ A committee of school staff and parents should 
meet to decide how the FRC would fit into the 
school system. 

■ Space is needed in the school for the FRC: 
office, confidential meeting rooms, file 
cabinet, comfortable furniture, a telephone, 
a video-camera to record sessions, and 
computer software. 

■ An organized school operating system with 
a clear referral and reporting system is 
fundamental to successful implementation. 


According to Dishion & Kavanagh (2003) and 
Dishion (personal communication September 
13, 2006) barriers to implementation include 
the following: 

■ A lack of performance based standards, lack 
of funding, and changes in interest of the 
administrative leadership; 

■ A lack of engagement of parents; and 

■ Attitudes of negativity and avoidance 
of the intervention. 


Training/coaching and materials 

As indicated by Dishion (personal communication, 

September 13, 2006): 

■ Stage 1 training includes a 4- to 5-day workshop 
for school and staff personnel on specific 
program components. 

■ Stage 2 training involves reviewing video-taped 
sessions of group leaders to provide specific feed 
back about work. 

■ Stage 3 training, an advanced series of 
workshops around issues that experts have to 
deal with when implementing the intervention, 
is currently in development. 

■ Ongoing support is provided by the developers 
by telephone and email. Communication is 
voluntary, with the frequency determined by 
the site’s needs. 

■ Currently, program materials may be purchased 
and implemented in a component fashion 

(for example, choosing to implement only 
the Family Checkup Intervention.) 

■ Training of trainers who are then qualified 
to train for their agency is available. 

■ Materials are available in Spanish. 

Information about training 

and materials can be obtained at: 

http://www.uoregon.edu/~cfc/atptraining.htm 
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Cost of training/consulting 

The ATP program works individually with sites 
to tailor the training to available resources of 
school budgets. There is a per service fee for 
training and consultation: 

Level 1: Universal: 

Family Resource Centers Training 

■ Length: 6 hours 

■ Limit: 20 people 

■ 1-2 people, $500 + $25 each/materials 

■ 3-5 people, $750 + $25 each/materials 

Level 2: Selective: 

Family Check-Up Training 

■ Length: 2 days 

■ Limit: 20 people 

■ 1-2 people, $1350 + $75 each/materials 
(includes feedback on your implementation) 

■ 3+ people, $1850 + $75 each/materials (includes 
feedback on implementation). 

Level 3: Indicated: 

Family Management Curriculum Training 

■ Length: 1.5 days 

■ Limit: 20 people 

■ 1-2 people, $750 + $75 each/materials 
(excluding tapes) 

■ 3+ people, $1000 + $75 each/materials 
(excluding tapes) 

Consultation 

■ $75/hour (any format: tape review, video 
conferencing, phone, review of materials, 
and so forth). 

■ There are additional travel fees and expenses 
if the training takes place at the program site. 


Additional information can be obtained at: 

http://www.uoregon.edu/~cfc/atp.htm. 


Developer involvement 

The developers are currently involved in training 
and implementing the program: 

Tom Dishion, Ph.D. & Kate Kavanagh, Ph.D. 

Child and Family Center 
195 West 12th Avenue 
University of Oregon 
Eugene, OR 97401-3408 
Phone: (541) 346-4805 
Fax: (541) 348-4858 
Email: tdishion@uoregon.edu 
kavanagh@uoregon.edu 


Monitoring fidelity and outcomes 

Currently, monitoring fidelity occurs through 
the process of a trained supervisor’s review 
of videotapes of group leaders working with 
the families. 

■ Fidelity ratings are provided by supervisors. 

■ Sites are required to provide fidelity data 
to the developer every 6 months. 

■ Collecting and reporting outcome measures 
is recommended. 

■ No formal training is provided to sites to 
develop systems to collect, analyze, or use 
outcome data collected. 


Financing the intervention 

Financing the intervention is through a site 
budget, primarily through federal grants. 
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Resources/Links 

For information on the Child and Family 
Research Center at the University of Oregon, 

see http://www.uoregon.edu/~cfc/atp.htm. 

For information about purchasing available 
resources, see http://www.guilford.com/cgi-bin/ 
cartscript.cgi?page = cpap/dishion.htm&cart Jd. 

For additional information, see also 

http://www.strengtheningfamilies.org/html/ 
programs_1999/08 ATP.html. 
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Incredible Years 


Intervention Description 


Background 

The Incredible Years series has been developed 
since the 1980s by Carolyn Webster-Stratton, 
Pli.D., of the University of Washington. Numerous 
studies have demonstrated many positive outcomes 
for children and their families in a variety of 
settings and countries. 

The program has been disseminated in more 
than 46 states, Canada, Norway, Denmark, Wales, 
New Zealand, and Great Britain. In addition, the 
program has been tested with different cultural 
groups, such as East African, Vietnamese, 

Hispanic, and Chinese populations. Many of 
the materials have been translated into different 
languages to meet these varying cultural, ethnic, 
and linguistic needs. 


Characteristics of the intervention 

The Incredible Years program offers a comprehensive 
array of materials for parents and teachers and is 
tailored developmentally for children. The goal 
of this intervention is to reduce child aggression 
(ages 2 to 12) by teaching parents and teachers 
how to manage children’s misbehavior and 
promote children’s problem-solving strategies, 
emotional regulation, and social competence. 

It can be delivered by parents, teachers, counselors, 
social workers, and therapists. These people must 
possess a bachelor’s degree, but a master’s degree is 
recommended for the parent and teacher program. 
Children who are actively displaying clinical levels 
of externalizing problems or who are at risk of 
aggressive behavior can receive the Incredible Years 
intervention components. Therefore, Incredible 
Years can be considered a multilevel prevention 
and intervention program. 


Figure 8 


Incredible Years 

Type of EBP 

■ Intervention 

Setting 

■ Home 

■ School 

Age 

■ 2-12 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Increase in parent's use 
of effective limit-setting, 
nurturing, and supportive 
parenting. 

■ Improvement in teacher's use 
of praise. 

■ Reductions in conduct 
problems at home and school. 


The BASIC program (parent training) is the core 
component of Incredible Years, with the Teacher 
Training and Child training program 
complementing BASIC. The BASIC program 
has a preschool version (ages 2 to 5 years) and 
a school-age version (ages 6 to 12 years). 

The BASIC program also has three other training 
components: the School Readiness Series, the 
School Age Program, and the ADVANCE program. 

BASIC is a 12- to 14-week group-based program 
using video-vignettes to trigger group discussion. 
The emphasis is on parents’ learning behavior 
management, social and emotional coaching skills, 
empathy, and ways to meet their children’s 
temperamental and developmental needs. 
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BASIC also consists of parents’ learning effective 
and nonviolent discipline strategies. The School 
Age component strives to assist parents with ways 
to strengthen their children’s academic performance 
at home and bridge the communication between 
school and home. The ADVANCE program is a 
complement to the BASIC program, a 10- to 
12-week supplement that addresses marital issues, 
communication skills, anger and depression 
management, and parental problem-solving skills. 
This supplement helps parents develop a better 
understanding of their own interpersonal issues 
and provides them with new coping skills. 

The Teacher Training program is a 6-day workshop 
for teachers, counselors, and school psychologists 
to teach basic classroom management strategies 
for dealing with misbehavior and promoting 
positive peer relationships through student skill¬ 
building. Detailed behavior plans for managing 
children with externalizing and internalizing 
problems are developed. 

The Child Training Program (Dinosaur Curriculum) 
focuses on appropriate classroom behavior, 
increased positive social skills, emotional literacy, 
anger management, and problem-solving skills 
for managing conflict. There is both a prevention 
classroom version of this curriculum as well as 
a small group treatment version. 

The treatment version is offered to small groups 
of children (five to six per group) with conduct- 
related problems. The treatment groups are usually 
offered once a week for 2 hours or twice a week 
for an hour. The classroom version is offered two 
to three times weekly in circle-time discussions 
followed by small group activities. There are lesson 
plans for preschool through second grade. 


Research Base and Outcomes 

Extensive research has examined the efficacy 
and effectiveness of the Incredible Years series. 
Numerous randomized control group trials have 
been conducted by Webster-Stratton and 
colleagues, with at least an additional 15 studies 
by independent researchers replicating and 
measuring the effectiveness of the intervention. 

Studies include eight randomized clinical trials by 
the developer and colleagues and five replication 
studies by independent investigators examining 
the parent training component (BASIC); 
two randomized clinical trials evaluating the 
effectiveness of the child training program; 
and two randomized clinical trials examining 
the teacher training program. 

Studies have been conducted with different ethnic 
populations and in varying treatment settings (for 
example, foster care, daycare facilities, Head Start 
Families). Studies have been conducted in the 
United States, Canada, Norway, and the United 
Kingdom (http://www.incredibleyears.com). The 
intervention has been tested with various cultural 
groups: East African, Vietnamese, Chinese, and 
Hispanic (St. George, personal communication, 
April 19, 2006). 

Table 8 provides an overview of research outcomes. 
For those interested, an extensive fist of research 
articles is available at: http://www.incredibleyears.com. 
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Table 8: Incredible Years: Research Base and Outcomes 


Reference 
BASIC Program 

Webster-Stratton (1981, 
1982, 1984, 1990, 
1994, 1998; In press); 
Webster-Stratton & 
Hammond (1997); 

Webster-Stratton, 
Hollingsworth, & 
Kolpacoff (1989); 

Webster-Stratton, 
Kolpacoff, & 
Hollingsworth (1988); 

Reid, Webster-Stratton, 
& Beauchaine (2001); 

Gross et al., (2003); 

Reid, Webster-Stratton 
& Hammond (2007) 


Research Design and Sample* 

8 randomized control trials and 5 replication studies 
Study population: 

1982 study (n = 35) 

■ 66% Male 

■ 34% Female 

1984 study (n = 35) 

■ 71% Male 

■ 10% Female 

1988 and 1989 study (n =114) 

■ 69% Male 

■ 31% Female 

1997 study (n = 97) 

■ 74% Male 

■ 26% Female 

■ 86% White 

2001 study(n = 634) 

■ 54% Male 

■ 46% Female 

■ 54% White 

■ 19% African American 

■ 12% Asian American 

■ 11% Hispanic 

2003 study (n = 208) 

■ 57% African American 

■ 29% Hispanic 

■ 4% White 

■ 4% Multiethnic 

■ 6% Other 


Outcomes 


Increases in parent positive affect such as praise and 
reduced use of criticism and negative commands. 

Increases in parent use of effective limit-setting 
by replacing spanking and harsh discipline with 
nonviolent discipline techniques and increased 
monitoring of children. 

Reductions in parental depression and increases 
in parental self-confidence. 

Increases in positive family communication and 
problem-solving. 

Reduced conduct problems in children’s interactions 
with parents and increases in their positive affect 
and compliance to parental commands. 

Reduced conduct problems, increased emotional 
regulation with parents. Mothers were more 
supportive and less critical with their children. 

Teachers reported parents were more involved 
in school, and children were less aggressive in 
the classroom. 


Teacher Training Series 

Webster-Stratton et al., 
(2004); 

Webster-Stratton et al., 

( 2001 ) 


2 randomized control trials 
Study population: 

■ 2004 study 

■ 90% Male 

■ 10% Female 

■ 79% White 


Increases in teacher use of praise and 
encouragement and reduced use of criticism 
and harsh discipline. 

Increases in children's positive affect and 
cooperation with teachers, positive interactions 
with peers, school readiness and engagement 
with school activities. 

Reductions in peer aggression in the classroom. 


Child Training Series 

Webster-Stratton & 
Hammond, 1997; 

Webster-Stratton 
et al., 2004 


2 randomized control trials 
Study population: 

1997 study (n = 97) 

■ 74% Male 

■ 26% Female 

■ 86% White 

2004 study (n = 1 59) 

■ 90% Male 

■ 10% Female 

■ 79% White 


Increases in children's appropriate cognitive 
problem-solving strategies and more prosocial 
conflict management strategies with peers. 

Reductions in conduct problems at home 
and school. 


’ Study sample's gender and race/ethnicity data provided when available. 
’* Table adapted from version found at http://www.incredibleyears.com. 
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Implementation and Dissemination 


Infrastructure issues 

An agency readiness questionnaire is available 
for download on the Incredible Years Web site. 
After a site reviews and determines some of their 
readiness issues, the Incredible Years staff is 
available to help sites address their issues. 

For some sites, assistance is offered in securing 
money by helping with grant writing. 

For Incredible Years to be successfully implemented 
and sustained, an agency and school must have 
continued funding support. In addition, it is 
important to have staff go through the mentoring 
and group certification process to help continue 
to implement the program with fidelity. 


Training/coaching and materials 

The training and materials for each program series 
vary. Each training series focuses on the parents, 
child, and teacher. All of the training manuals and 
other supportive materials can be ordered through 
the Incredible Years Web site. 

Prices for the manuals and materials range from a 
few hundred dollars for a single program to $1,800 
dollars for one complete parent training set of 
BASIC and ADVANCE. 

Trainings are tailored to meet the needs of the 
identified site. Mental health agencies or schools 
may choose to be trained by the Incredible Years 
certified trainers onsite or offsite, depending on 
the size of the audience. For larger groups, 15 to 
25 people, onsite training is offered. Offsite 
training would occur in the Seattle, Washington, 
area. Cost for the training varies depending on the 
type of training that a site chooses. 

Certification is also offered by Incredible Years and 
is highly recommended. Certification indicates that 
a group leader is offering the program with fidelity. 


Certified group leaders are eligible for certification 
as mentors, which allows them to train others in 
authorized workshops in their own agency. To 
become certified as a mentor, one must have either 
a masters or doctoral degree. Certification is an 
additional training process and mentors in training 
receive close supervision and contact with the 
developer, Dr. Webster-Stratton and other certified 
trainers. Certification costs range from $150 to 
$700. 

Some of the training materials have been 
translated into multiple languages. The BASIC 
parent program has translated manuals in Spanish, 
French, Norwegian, Swedish, Dutch, Danish, 
Russian, and Portuguese. In addition, some of the 
programs are also being used in Hong Kong, 
Singapore, and Malaysia. 

The Parent Training curriculum comprises 
different sets of materials and manuals that are 
appropriate for different developmental age 
groups. The training time is approximately 3 days. 
The BASIC parent training program has two 
versions, one for early childhood (2 to 7 years) and 
one for school age (5 to 12 years). In addition, 
there is an advanced training program for school- 
age youth. There is also a school readiness program 
available to help prepare children for school. Costs 
for these training sets vary according to the 
material purchased. 

The Dinosaur training curriculum is available for 
use by teachers or counselors and therapists. The 
training time for this series lasts about 2 to 3 days. 
This training program can be implemented in 
either a small group of children displaying 
aggressive behavior or as a prevention program for 
an entire classroom. Puppets, videos, and manuals 
are used to facilitate learning. 

The teacher classroom-management training 
curriculum has different training manuals and 
materials. The training lasts about 3 days for group 
leaders. Teachers participate in training that lasts 
5 to 6 days. The different programs are geared 
toward preschool and school-age children. 
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There are supplemental video vignettes and 
instructions for teachers working with the 
Dinosaur program and school-aged population. 


Cost of training/consulting 

The cost for each site will vary depending on 
the type of training requested and the materials 
purchased. Training offsite in Seattle ranges 
from $300 to $400 per person. Training at ones 
agency costs $ 1,500/per day for one trainer, plus 
transportation costs and other travel expenses. 
Consultation services range from $150 to 
$200/per hour. 


Developer involvement 

Dr. Webster-Stratton is directly involved in 
disseminating the Incredible Years program. She 
continues to deliver these programs with families, 
teachers, and children and to serve as a consultant 
to other research projects trying to replicate her 
program. At the same time, she conducts her own 
research studies evaluating new program 
components of the Incredible Years Series. 
Currently she is evaluating the program with 
parents of children with Attention Deficit 
Disorder. To obtain more detailed information 
about Incredible Years, please contact the 
Administrative Director: 

Lisa St. George 

Administrative Director 

Incredible Years 

1411 8th Avenue West 

Seattle, WA 98119 

(888) 506-3562 or (206) 285-7565 

http://www.incredibleyears.com 

incredibleyears@incredibleyears.com 


Monitoring fidelity and outcomes 

Fidelity measures exist for the curricula within the 
Incredible Years program. Incredible Years is not 
collecting fidelity measures on a widespread basis. 

Outcome measures are recommended, but 
sites do not have to report this information to 
Incredible Years. 


Financing the intervention 

According to the developer, many sites receive 
grants; others build the program into their ongoing 
services to receive funding from their state. 
Incredible Years does not track financing 
information from sites that have successfully 
implemented the program. 


Resources/Links 

http://www.incredibleyears.com 
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Helping the Noncompliant Child 


Intervention Description 


Background 

Helping the Noncompliant Child (HNC) is a 
parent-training program that was developed out 
of the original work in the late sixties by Constance 
Hanf, Ph.D., and Rex Forehand, Ph.D., of the 
Universities of Vermont and Georgia, respectively. 
Robert McMahon, Ph.D., of the University of 
Washington modified Hanf’s program to develop 
HNC more than 30 years ago. 

HNC offers a controlled learning environment 
for parents to learn new “adaptive” ways to 
interact with their children. Currently, it is being 
implemented in more than a dozen states and 
several foreign countries (for example, Canada, 
United Kingdom, Australia) (Forehand, 2006). 


Characteristics of the intervention 

Helping the Noncompliant Child’s primary 
treatment goal is the secondary prevention of 
serious conduct disorder problems in preschool 
and early elementary school-aged children, and 
the primary prevention of subsequent juvenile 
delinquency (Office of Juvenile Justice and 
Delinquency Prevention Model Programs Guide). 

The program is delivered to boys and girls 3 to 8 
years of age who are at risk for or are displaying 
aggressive and oppositional behaviors. It is best 
implemented in a therapeutically controlled 
environment, such as a clinic-based playroom with 
a one-way mirror and audio equipment (although 
the mirror and audio equipment are not required). 
HNC can also be delivered in the child and family’s 
home. Children and their parents meet while the 
therapist helps guide parents with practicing new 
skills and focusing on the positive and negative 
behaviors of the child. 


Figure 9 


Helping the Noncompliant Child 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

■ Home 

Age 

■ 3-8 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Improvement in parenting skills 

■ Improvement in child's 
behavior and compliance 


The parent-training program is divided into 
the following two phases: 

■ Differential Attention; and 

■ Compliance Training. 

The length of the program depends on each family, 
but typically a total of 8 to 10 sessions are standard 
for both training periods. Average sessions last 
approximately 75 to 90 minutes. Ideally, sessions 
should occur about twice a week. If parents do 
not have the resources or time for twice weekly 
sessions, the therapists are encouraged to keep 
in phone contact. 

Therapists who deliver the HNC program must 
possess a master’s degree. Throughout the training, 
a therapist will assign homework to facilitate 
parents’ practicing what they have learned in 
the controlled environment. It is essential to 
the program that parents agree to practice the 
parenting skills between sessions as directed 
by the therapist. 

In the Differential Attention phase, a major goal 
is to break out of the coercive cycle of interaction 
by establishing a positive, mutually reinforcing 
relationship between the parent and child. 
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Parents learn to systematically use different types 
of positive attention (that is, verbally tracking the 
child’s behavior, praise, positive physical attention) 
to increase desirable child behaviors. They also 
learn a planned ignoring procedure to decrease 
undesirable child behaviors (McMahon & 
Forehand, 2003). 

Succession through the phases depends on parent’s 
skill acquisition as assessed by the therapist 
(observational forms available in training book). 
During the Compliance Training phase, parents 
learn to do the following: 

■ Give clear, concise instructions to their child; 

■ Provide positive attention for child compliance 
to the instruction; and 

■ Use a brief time-out procedure for child 
noncompliance. 

Parents also learn to use rules, and to implement 
the phase I and II skills in settings outside the 
home. Therapists extensively employ demonstration 
and role-play procedures to teach the different 
skills to the parent and to the child who also 
participates in the treatment sessions. 


Research Base and Outcomes 

HNC has been extensively researched since 
the 1970s in a series of studies that examined 
various aspects of the intervention (McMahon 
& Forehand, 2003). Research has included 
the following: 

■ Clinic laboratory observation studies 
to examine the effects of the individual 
components of HNC. 

■ Clinic laboratory observation and comparative 
studies to examine immediate outcomes of the 
program as a whole in the laboratory setting. 

■ Studies in community settings using single 
group or comparison group with pre-post tests 
and followup to examine generalizability of the 
effects across time, settings, siblings, 

and behaviors. 

■ Studies assessing: social validity, side effects, 
procedures for enhancing generalization, and 
self-administered written forms of components 
of the intervention. 

■ Two independent replication studies comparing 
HNC to other interventions. 

Samples, while predominantly Caucasian, have 
included African American populations as well 
(McMahon & Forehand, 2003; NREPP). 

Research has shown many positive outcomes: 
improvements in parenting skills and child 
compliance in the home to within the normal 
range; improvements of parents’ perceptions 
of their children’s adjustment, regardless of the 
children’s age (within the 3- to 8-year-old range) 
or the families’ socioeconomic status (although 
families from lower socioeconomic backgrounds 
are less likely to complete the program); and 
maintenance effects ranging from 6 months to 
more than 14 years after treatment termination 
(McMahon & Forehand, 2003). See Table 9. 
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Table 9: Helping the Noncompliant Child: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Peed, Roberts, & 
Forehand (1977) 

Mothers (n = 12) and their children (2.5-8.5 years) assigned to either 
a treatment or a waitlist control group. Parent training conducted in a 
controlled learning environment. 

Study population: 

■ 67% Male 

■ 33% Female 

Both parents and children in treatment group report 
demonstrated multiple positive behavior changes of 
parent-child interactions such as parents' perceptions 
of children. The control group did not change over 
the waiting period. 

Wells, Forehand, 

& Griest (1980) 

Noncompliant, clinic-referred children and their mothers (n = 12) who 
received parent training program (F1NC) compared to non-clinic, non¬ 
treatment normative group (n = 12). 

Study population: 

■ 62.5% Male 

■ 37.5% Female 

Clinic-referred children significantly increased their 
compliance from pretreatment to post treatment, 
whereas the non-clinic group did not. For the clinic 
group only, untreated child inappropriate behaviors 
decreased significantly (aggression, tantrums, crying) 

Baum et al., (1986) 

In McMahon & 
Forehand (2003) 

Children (n = 34, 6-10 years) and their parents received either HNC 
intervention or a parent discussion group based on Systematic Training for 
Effective Parenting (STEP). 

Observed behavior improvements in the HNC 
group at both post-treatment and 6-8month 
followup. No change in behavior for STEP group. 

Wells & Egan 
(1988) 

Families (n = 19) with a child (ages 3-8 years) with OD, randomly assigned 
to receive either social learning based parent training (HNC) or family 
systems therapy. 

Observation measures of parent child behaviors 
found HNC more effective than family 
systems therapy. 


* Study sample's gender and race/ethnicity data provided when available. 


Implementation and Dissemination 


Infrastructure issues 

Readiness: 

No formal readiness assessment is used for sites 
interested in becoming trained to deliver HNC. 


Training/coaching and materials 

■ Currently, qualified trainers are readily available 
to provide training in HNC for all areas of 

the country. 

■ The training requires at least 2 days. 

■ There is no minimum number of training 
participants. However, there is a maximum 
of 16 to 20 participants in a training session. 


Onsite practice and followup supervision can 
be provided. On an individualized basis, the 
trainers can offer further onsite or offsite 
technical assistance. 

■ Trainees of the model should be prepared 
to role-play. 

■ If staff turns over, the developers will consult 
within the agency to help them train the 
new staff. 

The trainer’s manual, training videotape, and 
self-help book for parents must be purchased 
separately (see http://casat.unr.edu/bestpractices/view. 
php?program = 45). 

The training manual is Dr. McMahon and 
Dr. Forehands (2003) book, Helping the 
Noncompliant Child: Family-Based Treatment for 
Oppositional Behavior, New York: Guilford Press. 
The developers encourage trainees to read the 
book prior to the training. 
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The book for parents ( Parenting the Strong- 
Willed Child , Forehand & Long, 2002) has 
been translated into several languages and is 
available from McGraw-Hill for $14.95. 

The training videotape is available from Child 
Focus, 17 Harbor Ridge Road, South Burlington, 
VT 05403, for $29.95. 

To obtain information on training and materials, 
contact Dr. McMahon. 

Robert J. McMahon, Ph.D. 

University of Washington 

Department of Psychology, Box 351525 

Seattle, WA 98195-1525 

Phone: (206) 543-5136 

Fax: (206) 685-3157 

Email: mcmahon@u.washington.edu 


Cost of training/consulting 

■ Training costs: $l,500/day plus expenses 
(2- day minimum). 

■ Per Dr. Forehand (personal communication, 
June 23, 2006) the typical cost to train therapists 
and to provide ongoing support in providing 
Helping the Noncompliant Child would average 
$7,000 to $12,000, depending on the extent to 
which post-initial training booster sessions and 
telephone consultation are involved. This 
includes materials. 


Developer involvement 

■ Developers can be contacted directly to help 
implement the intervention. 

■ The developers are responsible for providing the 
2-day onsite training as well as followup services. 


Monitoring fidelity and outcomes 

A fidelity checklist is available from Dr. 

Forehand at rex.forehand@uvm.edu. Measures 
for assessing outcomes are available from 
McMahon and Forehands’ 2003 book, Helping the 
Noncompliant Child: Family-Based Treatment for 
Oppositional Behavior. 

The developers are not actively involved in collecting 
fidelity measures for program sites, although sites 
can choose to submit fidelity data to the developers. 

■ Developers are willing to help sites develop 
systems to collect, analyze, and use data to 
improve services. 

■ Sites do not have to submit outcome measures 
to the developers, but it is highly recommended. 


Financing the intervention 

■ According to Dr. Forehand, the majority of 
financing is through state funding or private 
grant dollars. 

■ Some third-party payers for mental health 
services (for example, Medicaid, private 
insurers) will also reimburse for the components 
of the service as outpatient therapy. 

■ To sustain the program, the developers advise 
that the cost of the program be built into 
multiple years of funding. The developers 
are willing to collaborate on an ongoing basis 
after the program has been implemented. 
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Resources/Links 

To learn more about Helping the Noncompliant 
Child, see: 

■ Office of Juvenile Justice and Delinquency 
Prevention (OJJDP) Model Programs Guide: 

http://www.ojjdp.gov/MPG 

■ McMahon and Forehand’s (2003) book, 
Helping the Noncompliant Child: Family- 
Based Treatment for Oppositional Behavior. 
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Parent-Child Interaction Therapy 


Intervention Description 


Background 

Parent-Child Interaction Therapy (PCIT) is a 
parent training/coaching program for families 
with children 2 to 7 years of age who are exhibiting 
disruptive behaviors. This program has been in 
existence since the early seventies. 

It was developed by Shelia Eyberg, Ph.D., of the 
University of Florida. The development of PCIT 
was influenced by the earlier work of Constance 
Hanf, Ph.D., and Diane Baumrind, Ph.D. 

Dr. Hanf was focused on working with mothers to 
increase their child’s compliance, and Dr. Baumrind 
studied how different parenting styles affect children. 
Currently, PCIT is being implemented in the 
United States, Puerto Bico, Norway, and Hong 
Kong. It has been implemented in laboratory 
clinical settings, community mental health systems, 
Head Start programs, schools, and foster care 
settings (B. Chase, personal communications, 
September 21, 2006). 


Characteristics of the intervention 

The program has two phases that are based on 
attachment theory and social learning theories. 

In the first phase of the training. Child Directed 
Interaction (CDI), parents learn how to strengthen 
their attachment to their child through being warm, 
responsive, and sensitive to their child’s behavior. 

In the second phase of the training, Parent 
Directed Interaction (PDI), parents learn how to 
be strong authority figures with their child through 
giving directions in age-appropriate, positive ways; 
setting consistent limits; and learning how to 
appropriately implement consequences, such 
as time-out. 


Figure 10 


Parent-Child Interaction Therapy 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

Age 

■ 2-7 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Improvement in parent-child 
interaction style. 

■ Improvement in child behavior 
problems. 


PCIT is structured through 10 to 16 weekly 1-hour 
sessions with either the parent alone or parent and 
child together, and delivered by trained master’s 
or doctoral level therapists. These sessions 
consist of the following (Herschell et al., 2002; 
http://www.pcit.org, retrieved 2006): 

■ Pre-treatment assessment of child and family 
functioning; 

■ Teaching, coaching, and feedback in the CDI 
skills phase; 

■ Teaching, coaching, and feedback in the PDI 
skills phase; 

■ Teaching generalization skills related to rules 
at home, behavior in public, and behavior 
with siblings; 

■ Five to 10 minutes of homework per day 
practicing learned interactions; and 

■ Posttreatment assessment of child and 
family functioning. 

Clients progress through the sessions of each phase 
by achieving set skills that are monitored and 
assessed by the therapist. In research settings, the 
therapist uses a one-way mirror to observe the 
parent-child interactions and coaches the parents 
through a microphone in their ear (Herschell, 
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2002). In nonlaboratory community settings, some 
changes to the therapy have been made, but the 
effectiveness of PCIT with these changes is 
unknown (Franco et al., 2005). 


Research Base and Outcomes 

PCIT originated in 1982 and has been tested in a 
number of replication and followup studies. PCIT 
has been found to be efficacious in improving the 


interaction style of parents and in improving 
behavior problems of children at home and in 
school, in comparison to waitlist control groups, 
normal classroom control groups, untreated 
classroom control groups, modified treatment 
groups, treatment dropouts, and in comparison 
to children with varying severity of problems 
(Herschell et al., 2002). 

New directions of the research include support for 
a culturally sensitive adaptation of PCIT for Puerto 
Rican families (Matos et ah, 2006). See Table 10. 


Table 10: Parent-Child Interaction Therapy: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Eyberg & Robinson 
(1982) 

Families (n = 7) with one child (age 2-7) with a behavioral problem and 
also a sibling (age 2-10) without a behavioral problem. Changes observed 
in pre-post test observed ratings. 

Study population: 

■ 86% Male 

■ 14% Female 

Significant improvements on observer ratings of 
child behavior, untreated sibling behavior, and 
parental adjustment. 

McNeil, Eyberg, 
Eisenstadt, 

Newcomb, 

& Funderburk 
(1991) 

Children (n = 30). Control Group design, but not randomly assigned. 

Children treated with PCIT (n = 10) compared with normative control group 
(n = 10) and problem behavior control group (n = 10). 

PCIT group reduced problem behaviors at home, 
improvements on the number of classroom 
measures for disruptive behaviors. 

Schuhmann, 

Foote, Eyberg, 

Boggs, and Algina 
(1998); 

Boggs et al., (2004) In McMahon et al., (2005) Randomized control design 
with families with 3-6 year old child with ODD (n = 64) assigned to 
treatment of PCIT or a waitlist control condition. 

Study population: 

■ 77% White 

■ 14% African American 

■ 9% Hispanic, Asian American, and Multiethnic 

Followup study from Schumann et al., (1998) 
compared 23 families that completed PCIT to 23 
families that dropped out. 

PCIT group demonstrated greater reductions in child 
behavior problems; parents expressed decreases 
in stress and increase in control; parent interacted 
more positively with their child and were more 
successful in gaining their child's compliance. Effects 
maintained at 4-month followup. 

Families who completed treatment maintained gains 
at followup. Families who did not returned to pre¬ 
treatment levels of child behavior problems. 

Nixon, Sweeney, 
Erickson, & Touyz 
(2003, 2004) 

Randomized control design with families with behaviorally disturbed 
children (n = 54, ages 3-5) assigned to PCIT standard group, PCIT modified 
group, or no treatment control group. 

Study population: 

■ 70% Male 

■ 30% Female 

■ 95% White 

■ 5% Australian Chinese, Australian Indian, Australian Koori 

Outcomes of an abbreviated version of PCIT 
was comparable to the regular PCIT at 6-month 
followup; treatment gains were maintained at 1 
and 2 years. 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Family involvement: 


Infrastructure issues 

Readiness: 

There is no formal readiness assessment. 

Facilities and equipment: 

It is advantageous to implement PCIT in similar 
conditions to which it was initially tested (that is, 
using a one-way mirror as the therapist coaches 
the parent in another room through a small 
microphone in the parent’s ear). For information 
about how to access this equipment, go to 
http://www.pcit.org. 

However, these conditions cannot always be 
met in community settings (R. Chase, personal 
communication, September 21, 2006). An alternative 
adaptation is for the therapist to sit next to the 
mother and coach by whispering in her ear. 

Implementation challenges: 

Implementation in a community mental health 
system (Franco, 2005) presented the following 
challenges and issues: 

■ Time commitment for implementation at 
each level of PCIT needed from clinicians, 
supervisors, and families. 

■ Management needed to remove barriers 
to clinician and family involvement. 

■ Additional training to ensure fidelity, as well 
as ongoing supervision and consultation. 

■ Keeping the interest and motivation of families 
to complete each phase of PCIT—it often takes 
longer to master skills than prescribed. 


PCIT includes therapy orientation sessions to 
describe the intervention, as well as the time and 
tasks required of the family, to assess the family’s 
willingness, to discuss barriers, and to problem- 
solve. The weekly therapy can be a burden for 
families with transportation difficulties or child 
care issues (R. Chase, personal communication, 
September 21, 2006). 


Training/coaching and materials 

Sheila Eyberg, Ph.D., and Stephen Roggs, Pli.D., 
are the master trainers with graduate students. 

Training is provided two to three times per year 
at the University of Florida and two times per year 
at the University of Oklahoma. Training is also 
provided at local sites for special projects, research 
grants, and in other countries than the U.S. 

PCIT experts at the University of Oklahoma 
Health Sciences Center are currently investigating 
an alternative co-therapy PCIT training model 
using Internet-based remote live consultation. 

The basic PCIT training involves a 5 full-day 
intensive workshop in PCIT, which includes an 
overview of PCIT, assessment procedures, coding 
system to identify interaction processes and skills 
acquired by parents in each phase, specific 
clinician skills training in the two phases of 
treatment, and adherence to the manualized 
treatment sessions. Training involves didactic 
instruction, role-playing, and a case demonstration. 

■ There is no standard booster training. 

■ A comprehensive treatment manual 
is available (Eyberg & Calzada, 1998). 

■ The materials are available in English 
and Spanish. 

■ Supervisor training involves a 3-day 
advanced training. 

To obtain information about materials and training, 
contact: http://www.pcit.org 
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Cost of training/consulting 

■ The cost per clinician trainee is $3,000. 

■ There is an additional cost for audiovisual 
equipment, which is desirable but not necessary. 

See http://www.pcit.org for pricing. 

■ There is no annual or ongoing cost 
for consultation. 


Developer involvement 

After the training, no ongoing formal relationship 
is expected between the developer and sites. 
However, consultation is available through 
email, telephone, and onsite visits as needed. 

There are no ongoing data collection requirements 
by the developer, unless the site is part of a research 
study. To contact the developer: 

Sheila Eyberg, Ph.D. 

Child Study Laboratory 

Department of Clinical and Health Psychology 

University of South Florida 

P.0. Box 100165 

Gainesville, FL 32610 

Phone: (352) 273-6145 


Monitoring fidelity and outcomes 

■ Fidelity adherence checklists are used for 
every session to monitor adherence to the 
treatment manual. 

■ Outcome measures for monitoring progress are 
recommended and are described on the PCIT 
Web site. These include the following: 

■ Eyberg Child Behavior Inventory; 

■ Sutter-Eyberg Student Behavior Inventory- 
Bevised; 

■ Dyadic Parent-Child Interaction Coding System 
to measure the quality of parent-child interactions; 

■ Therapy Attitude Inventory; 

■ Child Bearing Inventory; and 

■ Parenting Locus of Control - Short Form. 

The developers do not follow a site to collect data 

or monitor fidelity, unless the project is part of a 

formal research or evaluation grant. 


Financing the intervention 

PCIT has been funded through research and 
evaluation grants. In some states, it is financed 
through private insurance companies and Medicaid 
as family therapy. 
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Resources/Links 

PCIT Web site: http://www.pcit.org. 
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Parent Management Training — Oregon 


Intervention Description 


Background 

The Parent Management Training—Oregon 
(PMTO) model is based on social interaction 
theory developed by Gerald Patterson, Ph.D., 
Marion Forgatch, Ph.D., and colleagues at 
the Oregon Social Learning Center (OSLO). 
Currently, Dr. Forgatch of OSLC is leading 
dissemination efforts. 

PMTO is considered a behavioral preventive and 
clinical intervention model designed to enhance 
effective parenting and reduce coercive practices 
while making relevant adaptations for contextual 
factors (Forgatch, Patterson, & DeGarmo, 2005). 

Currently, PMTO is disseminated nationally in 
more than 30 sites in Norway. In the Netherlands, 
PMTO is disseminated with 30 therapists from 
four agencies who are currently in training within 
three major regions in the country (Amsterdam, 
Drenthe, and Leiden). 

The purveyors of PMTO are mentoring four 
supervisors in coaching. Within the United States, 
PMTO has been disseminated in 13 sites in the 
state of Michigan. 


Characteristics of the intervention 

PMTO is designed for boys and girls ages 4 to 12 
years who have displayed serious acting-out and 
disruptive behaviors. It is implemented in clinic 
and home-based settings by trained therapists 
(masters level), lasting approximately 20 sessions, 
although it can vary depending on individual family 
needs and skill acquisition. 


Figure 11 


Parent Management Training — Oregon 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

■ Home 

Age 

■ 4-12 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Significant reductions in 
child's behavior problems. 

■ Reductions in coercive 
parenting. 

■ Increases in effective parenting. 


Parents or guardians of identified children and 
youth must participate in treatment, since it is 
aimed at them. 

PMTO is a manualized approach to treatment as 
detailed in Parenting Through Change (Forgatch, 
1994) and Marriage and Parenting in Stepfamilies 
(Forgatch & Rains, 1997). Training materials are 
also available (Forgatch, Rains, & Knutson, 2005; 
Knutson, Rains, & Forgatch, 2006). 

PMTO has five essential implementation components 
(Forgatch, Patterson, & DeGarmo, 2005): 

■ Skill encouragement teaches prosocial 
development through breaking behavior down 
to small steps and contingent positive 
reinforcement. 

■ Discipline decreases deviant behavior with 
appropriate and contingent use of mild 
sanctions. 

■ Monitoring (supervision) tracks children’s 
activities, associates, and location. 
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■ Problem-solving skills help families negotiate 
agreements, establish rules, and set 
contingencies. 

■ Positive involvement assists parents with offering 
loving, positive attention. 


Research Base and Outcomes 

The program has been evaluated extensively in 
community settings. In addition, a number of 
comparison studies have been conducted using 
random assignments for treatment. 

Studies with active control groups have yielded 
promising results (Fonagy & Kurtz, 2002; 
McMahon, Wells, & Kotler, 2005). The evidence 
supports the claim that treatment effects may be 


generalized across settings, may be maintained 
for up to 2 years posttreatment, may benefit other 
children in the same family, and also may extend to 
other deviant behaviors beyond those emphasized 
in treatment (Fonagy & Kurtz, 2002). 

Cross-cultural replications of PMTO have been 
conducted in Norway (McMahon, Wells, & Kotler, 
2005; Ogden, Forgatch, Askeland, Patterson, & 
Bullock, 2005). Replication studies of culturally 
adapted parent management training are being 
conducted with Latino clients (Forgatch, personal 
communication, June 22, 2006; Martinez & 

Eddy, 2005). 

Evidence from a sample of studies indicating 
specific results are located in Table 11. 
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Table 11: Parent Management Training-Oregon: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Bernal, Klinnert, 

6-Schultz (1980) 

Randomized control trial design of families (n = 36) of a child (ages 5-12) 
with conduct problem were assigned to behavioral parent training, client- 
centered counseling or waitlist. 6-month, 1-year, and 2-year followups. 

Study population: 

■ 86% Male 

■ 1 4% Female 

Parent reports and paper-and-pencil tests of child 
deviance and parent satisfaction showed a superior 
outcome for behavioral parent training over client- 
centered treatment and waitlist control group, and 
no difference between the latter two groups. 

At followup, there was no maintenance of 
this superiority. 

Christensen, 

Johnson, Phillips, 

& Glasgow (1980) 

Randomized clinical trial of families (n = 36) with problem children ( 4-12 
years) assigned to either PMTO- individual format, PMTO- group format or 
bibliotherapy (control group). 

Study population: 

PMTO individual and group interventions both 
superior to bibliotherapy as indicated by measures 
of parent attitude and observational data collected 
from audio recordings made in homes of families. 


■ 78% Male 

■ 22% Female 


Patterson, 
Chamberlain & 

Reid (1982) In 
McMahon, Wells, 

& Kotler (2005) 

Randomized clinical trial design assigned families (n = 19) to parent 
training (PMTO) or waitlist control group (which became a comparison 
treatment group by default as 8 of the 9 families in the control group 
obtained treatment from other clinics in the community; treatment styles 
ranged from eclectic to behavioral). 

Reductions in a child's conduct problem behaviors 
when parents have been exposed to parent 
training versus waiting list control/comparison 
treatment group. 


Study population: 

■ 68% Male 

■ 32% Female 


Patterson & 

Chamberlain 

(1988); 

Families (n = 70) with children with conduct problems (6-12 years) 
randomly assigned to parent training or eclectic family therapy. 

Preliminary results indicated parent training 
intervention reduced child conduct problem 
behavior significantly. 

Reid (1987) (in 
McMahon, Wells, 

& Kotler (2005)) 


Mothers in parent training group reported 
significant reductions in self-reported 
depression levels. 

Bank et al., (1991) 

Randomized control trial design assigned families (n = 55) of chronically 
offending adolescent delinquents (13-18 years) to parent training courses 
or services typically provided by the court system. 

Results indicated that the parent training families 
exerted quick and effective control over their sons' 
official delinquency rates. 


Study population: 

■ 100% Male 

Relative to the controls, parent training families 
were able to establish control with significantly 
less reliance on incarceration. 

Forgatch & 

Degarmo (1999) 

Randomized control trial of divorcing mothers (n = 238) with sons in Grades 
1-3 (mean age 7.8 years) assigned to either treatment or control group to 
examine the efficacy of group-based parent training. 

Study population: 

Demonstrated positive effects of the intervention 
in reducing coercive parenting, prevented 
decay in positive parenting, and improved 
effective parenting. 


■ 100% Male 

■ 86% White 

■ 1% African American 

■ 2% Hispanic 

■ 2% American Indian 

■ 9% Multiethnic 


Martinez & Eddy 
(2005) 

Randomized control trial implementing a culturally adapted PMTO 
intervention, "Nuestras Familias," with Spanish-speaking Latino parents 
(n = 73) with middle school-aged youth at risk for problem behaviors, 
assigned to either intervention group or control group. 

Study population: 

■ 56% Male 

■ 44% Female 

■ 100% Hispanic 

Findings provide strong evidence for the feasibility 
of delivering the intervention in a larger community. 

Parent Outcomes: 

Increased measures of general parenting, skill 
encouragement, and overall effective parenting. 

Youth Outcomes: 

Decreased measures of aggression, externalizing 
likelihood of smoking and use of alcohol, marijuana, 
and other drugs. 


* Study sample's gender and race/ethnicity data provided when available. 


Evidence-Based and Promising Practices 


69 














Implementation and Dissemination 


Infrastructure issues 

Readiness: 

■ A set of readiness questions is available to 
assess sites’ abilities to effectively implement 
the program. 

■ Sites are selected if they have a long-term 
commitment to engage in evaluation, are willing 
to be subjected to evaluation, and are willing 
to devote the time to implement the program. 

■ If sites do not have the capacity (for example, 
time, staffing, and financial resources) to 
implement, the disseminators of PMTO 
suggest that they not use this intervention. 

In some cases, the purveyors will recommend 
other programs, such as Triple P, or the 
Incredible Years. 

Staffing: 

■ A readiness checklist is available for agency 
leaders and managers to use when hiring staff 
to implement the intervention. 

■ PMTO trainers consider staff selection to be an 
extremely high and important priority. One issue 
that is particularly important concerns staff 
biases toward behavioral approaches. 


Training/coaching and materials 

According to Dr. Forgateh (2006), 18 workshop 
days are spread over the course of a year to 
adequately train practitioners. 

■ The first two workshops are about a month 
apart, followed by three more. After the second 
workshop, practitioners should be working 
with families. Next, another set of three 
trainings occurs, which should take place 
2 to 3 months apart. 


■ Practitioners create a “fictional family” that is 
recorded on a DVD to demonstrate their skills, 
which expert trainers review. 

■ After review of the fictional family case, 
practitioners enroll three families and record 
their sessions. Direct feedback is provided by 
the expert trainers. 

■ Feedback continues to occur until about eight 
DVD-recorded sessions of three families are 
reviewed. 

■ After review of these eight sessions (on average), 
two new families are enrolled with 
approximately four sessions reviewed for final 
certification purposes. 

■ Ongoing support and coaching is provided 
through a network of coaches. 

■ There are approximately six PMTO trainers 
at the current time. 

Two books contain some of the manual and 
training materials, Parenting Through Change 
(Forgateh, 1994) and Marriage and Parenting 
in Stepfamilies (Forgateh & Rains, 1997). 

Materials related to PMTO are available in 
Norwegian, Dutch, Icelandic, and Spanish 
languages. Additionally, cultural adaptations for 
language, materials, and methods are negotiated 
between the program purveyors and the program 
recipients during the training process with each 
new culture. The fundamental method of training 
for professionals and for families is role-playing 
and not didactic (M. Forgateh, personal 
communication, July 22, 2006). 

The company that handles readiness, training, and 
implementation efforts is Implementation Sciences 
International, Inc. 
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Developer involvement 

Dr. Forgatch is the key developer of the intervention. 
She currently is involved in helping others use the 
program as part of a dissemination group that is 
directly involved with implementation efforts. 

Contact information: 

Marion S. Forgatch, Ph.D. 

Executive Director 

Implementation Sciences International, Inc. 

2852 Willamette Street, #172 
Eugene, OR 97405 
Email: marionf@oslc.org 


Monitoring fidelity and outcomes 

A site must commit to implementation with 
complete fidelity. Part of the readiness checklist 
assesses a site’s ability to do this and plans for 
followup fidelity checks. 

A recent study by Forgatch, Patterson, & 
DeGarmo (2005) found that using the Fidelity 
of Implementation Rating System to measure 
adherence to the program was effective. 
Specifically, if the program is implemented “true 
to the model,” parenting practices were improved. 


Financing the intervention 

In Michigan, for example, the state and agency 
collaborate in funding for PMTO training. 
Medicaid is also involved in financing. 

In Norway and the Netherlands, the government 
pays for the majority of the training and services; 
agencies share the cost. 


Resources/Links 

Substance Abuse and Mental Health 
Services Administration, National registry 
of Evidence-Based Programs and Pratices: 

http://nrepp.samhsa.gov/ 
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Brief Strategic Family Therapy 


Intervention Description 


Background 

Brief Strategic Family Therapy™ (BSFT™) 
is a family therapy intervention for children and 
adolescents aged 6 to 18 years who have engaged, 
or are engaging, in substance use, coupled with 
behavioral problems at home and school. 

BSFT™ was developed by the Spanish Family 
Guidance Center (which later became the Center 
for Family Studies) at the University of Miami, 
over 35 years ago to focus on drug use and behavior 
problems of Cuban American adolescents. 

For the first 15 years of BSFT™ s existence, 
therapists worked solely within the Hispanic 
population. However, since 1991, BSFT™ 
research has included African Americans. Within 
the past 2 years, more than 40 organizations and 
120 practitioners have participated in BSFT™ 
training (J. Szapocznik, personal communication, 
September 11, 2006). 


Characteristics of the intervention 

BSFT™ can be delivered in a variety of settings, 
such as social service agencies, mental health 
clinics, and local community health agencies. 

For youth to receive BSFT™ they must have a 
permanent family environment, thus excluding 
foster children. BSFT™ is delivered by clinicians 
with master’s level or higher degrees. 


Figure 12 


Brief Strategic Family Therapy 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

■ Home 

Age 

■ 6-18 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Decrease in substance abuse. 

■ Improved engagement in 
therapy. 

■ Decrease in problematic 
behavior. 

■ Increased family functioning. 

■ Decrease in socialized 
aggression and conduct 
disorder. 


Sessions last for approximately 60 to 90 minutes, 
for an average of 12 to 16 sessions. BSFT™ 
focuses on three central constructs: system, 
structure/patterns of interaction, and strategy 
(Szapocznik & Williams, 2000). The process 
of BSFT™ involves three components: joining, 
diagnosis, and restructuring. 

■ Joining is very important and occurs at two 
levels. These levels involve, first, establishing a 
relationship with each family member and, then, 
establishing a relationship with the entire family 
system. There are a number of techniques that 
may be used to join with the family. 

■ Diagnosis involves identifying the maladaptive 
patterns that encourage the problematic youth 
behavior. Therapists carefully observe and 
examine the family’s interactions along five 
domains: structure, resonance, developmental 
stage, identified patient, and conflict resolution. 
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■ Restructuring involves the therapists deciphering 
family patterns of interactions and developing 
specific plans to change maladaptive patterns. 
This is a problem-focused intervention aimed 
at the level of family system interactions that 
prevent each member from being successful. 
BSFT™ is designed to help the entire family 
system attain a higher level of functioning and 
to reduce problems such as the adolescents 
drug use and behavior problems. 


Research Base and Outcomes 

Numerous studies over the past 35 years have 
examined the effectiveness of BSFT™. Many 
of these studies were experimental in design, 
using randomized control trials to measure the 
effectiveness of the BSFT™ intervention compared 
to other interventions and/or a control group. 
Studies have demonstrated significant and positive 
effects of the BSFT™ intervention. Study 
populations have included primarily Flispanic 
families. A sample of specific research studies 
are listed in Table 12. 
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Table 12: Parent Management Training-Oregon: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Szapocznik, 

Kurtines, Foote, 
Perez-Vidal, & 

Hervis (1983; 1986) 

Hispanic families with adolescents with behavior problems (n = 37 in 1983 
study, n = 35 in 1986 study) randomly assigned to either conjoint family or 
one-person structured family therapy (BSFT™). 

Study population: 

■ 100% Hispanic 

Treatments equally effective in: 

■ Reducing substance use 

■ Reducing behavior problems 

■ Improving family functioning 

Szapocznik et. al., 
(1988) 

Examined the effectiveness of an enhanced engagement for hard to reach 
cases. Hispanic families (n = 108) in which adolescents (males and females) 
were observed with, or suspected of drug use, were randomly assigned to 
either the enhanced-engagement BSFT™ group or the control group (BFST™ 
engagement as usual condition). 

Study population: 

■ 100% Hispanic 

Increased engagement in therapy in the treatment 
group: 

■ 93% of families in the treatment group 
engaged in therapy vs. 42% of families in the 
control group. 

■ 77% of families in the treatment group 
completed treatment vs. 25% of the control 
group families. 

Szapocznik, et al., 
(1989 

Hispanic male children (n = 69, ages 6KI12) with moderate behavioral and 
emotional problems were randomly assigned to either the structured family 
therapy (BSFT™), psychodynamic therapy, or a recreational group. 

Study population: 

■ 100% Male 

■ 100% Hispanic 

Reduction of problem behaviors in both treatment 
groups. 

For BSFT™ improved family functioning at 

1-year followup. 

Santisteban et al., 
(1997) 

A basic one-group pretest/posttest/followup design with Hispanic and African 
American children (n = 122, ages 12-14) exhibiting problem behaviors 
assigned to BSFT intervention. 

Study population: 

■ 66% Male 

■ 34% Female 

■ 84% Hispanic 

■ 16% African American 

Intervention effective in reducing behavior problems 
and improving family functioning. 

Santisteban et 
al., (2000) (In 
Szapocznik & 
Williams, 2000) 

Hispanic boys and girls (N = 79) randomly assigned to either BSFT™ 
treatment group or group counseling control group. 

Study population: 

■ 100% Hispanic 

Participants in BSFT™ treatment group demonstrated 
reduction of problem behaviors, reduction in 
socialized aggression and conduct disorder more 
than group counseling. 

Santisteban et al., 
(2003) 

Hispanic adolescents (males and females) displaying behavioral and drug 
problems (n = 126, ages 12-18) were randomly assigned to BSFT™ or 
group counseling. 

Study population: 

■ 75% Male 

■ 25% Female 

■ 100% Hispanic 

BFST™ more effective in reducing marijuana use 
than control group. 

BFST™ treatment group demonstrated improved 
family functioning. 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

■ The BSFT™ Team has several teleconferences, 
followed by an onsite visit to agencies to assess 
their funding options, sustainability plan, and 
ability to deliver family services successfully. 

Possible barriers: 

■ The culture of the agency can affect the 
successful implementation of the practice of 
BFST™. Sped Really , some agencies put more 
emphasis on seeing as many clients as possible. 
On the other hand, some agencies are more 
actively engaged in retaining and keeping their 
clients in treatment, which would be a good fit 
for the BFST™ model (J. Szapocznik, personal 
communication, Sepstember 11, 2006). 


Training/coaching and materials 

■ Training infrastructure for the BSFT™ 
intervention can be tailored to meet the 
individual needs of the agency. BSFT™ training 
requires acquiring basic clinical skills in family 
systems therapy. 

■ BSFT™ involves four 3-day workshops followed 
by weekly supervision. Training methods involve 
didactic teaching, role playing, and videotape 
reviews. These workshops are conducted at the 
agency site. The first workshop introduces the 
basic concepts of BSFT™ using the training 
manual as guidance. The second workshop 
uses videotapes to teach how to diagnose 
family processes and to set up in-session 
family interactions. After the second workshop, 
therapists initiate treatment with new families, 
tape their sessions, and then send the tapes 

to be reviewed by BSFT™ trainers. The last 
two workshops are devoted to rehearsing very 
specific BSFT™ strategies for orchestrating 
change within the family system. 


■ After approximately 8 months of supervision, 
BSFT™ trainees are certified in the practice 

of BSFT™. This certification is renewable every 
2 years. Becertification would involve additional 
costs to the agency. 

■ All requests for training are made through the 
University of Miami’s Center for Family Studies, 
BSFT™ Training Institute. 

■ Information about training and materials can 
be obtained at: http://www.bsft.org/ 


Cost of training/consulting 

The cost for training workshops and supervision 
in BSFT™ is $60,000 per agency. This figure 
includes supervision for up to 8 months and all 
the materials, workshops, and phone consultations. 
Costs of BSFT trainer travel and per diem would 
be separately reimbursed. Contact: 

Adrienne Englert 

BSFT™ Training Institute Manager 

1425 NW 10th Ave 

Sieron Bldg, First Floor 

Miami, FL-33136 

Phone: (305) 243-7585 

Fax: (305) 243-2320 

Email: aenglert@med.miami.edu 


Developer involvement 

Jose Szapocznik, Ph.D., and colleagues of 
the University of Miami’s Center for Family 
Studies are involved in actively implementing 
and refining BSFT™. 
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Monitoring fidelity and outcomes 

■ Fidelity measures are collected weekly during 
the 8 months of supervision. After the 8 months 
of supervision, BSFT™ trainers collect fidelity 
measures at certification and re-certification. 

■ Outcome measures are not reported by the sites. 
Flowever, BSFT™ trainers will work with the 
sites interested in research to help them collect 
and analyze data. 


Financing the intervention 

BSFT’s startup costs and training have been 
funded using various grants. The BSFT™ Training 
Institute will assist agencies with securing funding 
through grant support. Many of the agencies fund 
ongoing BSFT™ services through their regular 
state funding. 

Some of the funding also comes from Medicaid 
(J. Szapocznik, personal communication, September 
11, 2006). In addition, third-party insurance payers 
can also fund the program through billing family 
therapy codes, or even case management. 


Resources/Links 

Office of Juvenile and Justice Prevention Program: 

http://wvwv.ojjdp.gov/MPG 

http://www.bsft.org/ 
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Problem-Solving Skills Training 


Intervention Description 


Background 

Problem-Solving Skills Training (PSST) is a 
cognitive behavioral approach for treating children 
ages 6 to 14 years with conduct and delinquency- 
related problems. This intervention was developed 
by Alan Kazdin, Ph.D., and his colleagues out 
of the earlier work of Myma Shure, Ph.D., and 
George Spivak, Ph.D., on problem-solving 
techniques for children. 


Characteristics of the intervention 

PSST emphasizes teaching skills related to the 
later stages of information processing (McMahon, 
Wells, & Kotler, 2005). The goal of this intervention 
is to improve a child’s interpersonal and cognitive 
problem-solving skills. This intervention is used 
with another intervention, Parent Management 
Training (McMahon, Wells, & Kotler, 2005). 

The Parent Management Training portion of 
the intervention is administered to parents or 
caregivers for approximately 15 sessions, lasting 
approximately 1.5 to 2 hours each. 

The therapist works with the parents or caregivers 
as the agents of change to help identify and address 
the child’s maladaptive thinking and behaviors 
(McMahon, Wells, & Kotler, 2005). 


Figure 13 


Problem-Solving Skills Training 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

■ Home 

Age 

■ 6-14 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Improvement in behavior as 
rated by teachers and parents. 

■ Family life functioning 
improvements. 


PSST is administered in 20 therapeutic sessions 
that last approximately 45 to 50 minutes each, 
and is delivered in either a clinic or a home setting 
by a master’s level therapist. 

PSST does not work with the children in groups, 
only individually with the child and parent. 

The therapist works with the child to review 
his or her process for addressing interpersonal 
situations and encourages the child to use a 
step-by-step approach with self-talk to achieve 
effective solutions (Fonagy & Kurtz, 2002). 

Modeling and direct reinforcement are techniques 
the therapist uses. Components of PSST will include 
practice, feedback, homework assignments, role- 
playing, and reinforcement schedules (Fonagy 
& Kurtz, 2002). 

Additionally the children receive in vivo practice 
to apply the skills in a variety of settings. In vivo 
practices involve structured assignments to 
help children apply problem-solving skills 
in everyday situations. 
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Research Base and Outcomes 

PS ST is an evidence-based intervention that has 
been extensively researched in randomized control 
designs for the past 30 years, with Kazdin and 
colleagues’ formative research beginning in the late 
1980s. Research studies have included samples of 
youth from both inpatient and outpatient settings, 
and both White and African American populations. 


Research has continued to demonstrate that the 
PS ST intervention significantly decreases aggression 
at home and in school, decreases deviant behaviors 
and increases prosocial behaviors. Additionally, 
research has demonstrated greater impact on 
outcomes when PSST is combined with Parent 
Management Training and Parent Problem-Solving 
Intervention. See Table 13. 


Table 13: Problem-Solving Skills Training: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Kazdin, Esveldt- 
Dawson, French, 

6-Unis (1987) 

Psychiatric hospitalized children (n = 56, ages 7-13) randomly assigned to 
PSST intervention group, relationship-based therapy, or control group. 

Behavioral ratings were obtained from parents and teachers pre- and post¬ 
treatment (after 1 year) to determine improvements. 

Study population: 

■ 80% Male 

■ 20% Female 

■ 77% White 

■ 23% African American 

PSST group had significantly greater decreases 
in externalizing, aggressive behaviors, behavioral 
problems at home/school, and increases in prosocial 
behavior and adjustment. 

Kazdin, Esveldt- 
Dawson, French, 

& Unis (1987) 

In Fonagy & Kurtz 
(2005) 

Psychiatrically hospitalized children (n = 40, ages 7-12) were randomly 
assigned to either a combined PSST and PMT intervention group or a 
minimal intervention control group. 

PSST/PMT group showed a reduction in aggression 
at home and at school, as well as increases in 
prosocial behavior. 

Kazdin, Bass, Siegal, 
& Thomas (1989) 

Random-assignment of mixed sample inpatient/outpatient children (n = 

112, ages 7-13) to a PSST group, a PSST group plus in vivo practice outside 
the treatment setting, or relationship therapy (control group). 

Both PSST groups showed significant reductions in 
deviant behaviors at 1-year followup: children in 
control group did not improve. 

Kazdin, Siegel, 

& Bass (1992) 

Children referred for severe antisocial behavior (n = 97, ages 7-13) and 
their families randomly assigned to a PSST only group, a PMT only group, 
or a combined PSST /PMT group. 

Study population: 

■ 78% Male 

■ 22% Female 

■ 69% White 

■ 31 % African American 

All three groups were associated with significant 
improvements at home, in school and in the 
community. Improvement was demonstrated in 
overall child dysfunction, prosocial confidence, 
and aggressive/antisocial and delinquent behavior. 

There was a greater impact demonstrated in 
the combined PSST/PMT group on measures 
of aggression, antisocial behavior, delinquency, 
parental stress, and depression. 

Kazdin & Whitley 
(2003) 

Children (n = 127, ages 6-14) and their families randomly assigned 
to a PSST and PMT group or a PSST, PMT and Parent Problem-Solving 
Intervention (PPS) group. 

Study population: 

■ 79% Male 

■ 21% Female 

■ 69% White 

■ 21 % African American 

■ 5% Hispanic 

■ 2% Asian American 

■ 3% Multiethnic 

Children's disruptive behavior improved whether 
or not the PPS intervention was introduced; the PPS 
families experienced greater therapeutic change 
and reduced barriers to treatment participation. 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Training/coaching and Materials 

Typically, a therapist would need a 6-month 
training period to learn how to deliver PS ST. 
Therapists are usually trained through academic 
research programs. A formalized intensive training 
for therapists is available for Parent Management 
training and soon will be available for PSST. 

For information about training and materials, 
contact: http://www.yale.edu/childconductclinic/. 


Cost of training/consulting 

Not applicable because training is not 
currently available outside of clinical 
academic research programs. 


Developer involvement 

The developer, Alan Kazdin, is not actively involved 
in disseminating or implementing PSST. However, 
workshops may be available for those interested in 
training. A formalized intensive training program 
is available for Parent Management Training at: 
http://www.yale.edu/childconductclinic/. 


Monitoring fidelity and outcomes 

Fidelity measures are in place. In addition, therapists 
are observed in a live session delivering PSST. 


Financing the Intervention 

PSST is typically covered by Medicaid, 
as it is clinic-based. 


Resources/Links 

http://www.yale.edu/childconductclinic/ 
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Coping Power 


Intervention Description 


Background 

The Coping Power program is an empirically 
supported program that was derived from the 
original Anger Coping Program. In the original 
Anger Coping Program, only a child component 
existed. In the Coping Power program, there is 
a child and a parent component. 

The program was developed by John Lochman, 
Pli.D., of the University of Alabama and Karen 
Wells, Ph.D., of Duke University School of 
Medicine. Coping Power has been disseminated 
and implemented in rural and urban settings 
in North Carolina; three counties in Alabama; 
a residential school for deaf children; international 
locations such as the Netherlands, Puerto Rico, 
and Spain; a university-public school system 
collaborative project; a medical school-community 
center and a graduate training center in Oregon. 


Characteristics of the intervention 

The program is intended for boys and girls, 
approximately 9 to 11 years of age (4th to 6th 
grade), who have been screened for disruptive 
and aggressive behavior. It has also been adapted 
for younger and older children. 

It is considered a prevention and intervention 
program, based on social-cognitive principles, that 
is most often implemented in a school environment. 
The social-cognitive model focuses on the contextual 
parenting processes and on childrens sequential 
cognitive processing (Lochman & Wells, 2004). 
Children with disruptive and aggressive behaviors 


cognitively distort incoming social cues and 
situations and inaccurately interpret events. 
Additionally, these children have an inability 
to effectively problem solve. 

Parents of aggressive children also affect the way 
in which a child handles a situation, and a negative 
pattern can be created between parent and child. 
Therefore, Coping Power focuses on addressing 
these cognitive distortions with the children and 
assisting parents with modifying their reactions 
to their children’s behavior. 


Figure 14 


Coping Power 

Type of EBP 

■ Intervention 

Setting 

■ School 

Age 

■ 9-11 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Decrease in substance abuse. 

■ Improvement in social skills. 

■ Less aggressive belief system. 


Coping Power has two components that work with 
one another. The entire Coping Power program 
can be delivered in 15 to 18 months in a school. 

■ The child component consists of 33 group 
sessions, which include eight sessions in the 
first intervention session (first academic year) 
and 25 in the second intervention year (second 
academic year). The group sessions last about 
40 to 60 minutes with approximately four to 
six children in each group led by a master’s 
level clinician. 
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During the child component sessions, the therapists 
emphasize behavioral and personal goal setting, 
awareness of feelings, use of coping self¬ 
statements, distraction techniques, relaxation 
methods, organizational and study skills, 
perspective taking, and social skills building. 

■ The parent component consists of 16 group 
sessions over the same 15- to 18-month period. 
Group sessions usually last 90 minutes and 
occur at the school. Sessions include groups 
of four to six single parents or couples led 
by master’s level clinicians. 

Parents acquire skills through training in 
identification of prosocial and disruptive behaviors, 
rewarding appropriate child behaviors, giving 
effective instructions, establishing age appropriate 
rules and expectations, developing effective 
consequences, and creating open communication. 


Research Base and Outcomes 

The Coping Power intervention, and its formative 
intervention, Anger Coping, has been extensively 
researched for over 20 years, with more than 48 
controlled studies in a variety of settings (Fonagy 
& Kurtz, 2002). The first randomized control study 
was in 1984 (Lochman, Burch, Curry, & Lampron). 

Research has demonstrated associations between 
the Coping Power intervention and improvements 
in children’s social skills, as rated by teachers, and 
less aggressive beliefs and anger in social situations. 
Studies have included both Caucasian and African 
American youth and families. 

Currently, the program is being evaluated in four 
grant-funded intervention research studies and 
has been translated and disseminated in clinical 
trials in the Netherlands (retrieved 11/3/2006, 


http://www.bama.ua.edu/~lochman/program_ 
background.htm). The Coping Power program has 
also been disseminated to aggressive deaf children 
in a residential setting (Lochman et al., 2001). 


See Table 14. 

Table 14: Coping Power: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Lochman, Burch, 
Curry, & Lampron 
(1984); 

Lochman & 

Lampron (1988). 

In Fonagy et al., 
(2005) 

First controlled evaluation with aggressive boys (n = 76, ages 9-12 years), 
teacher-identified sample, assigned to one of four groups: anger coping, 
goal setting, anger coping plus goal setting, or no treatment. 

Subsample followup of the 1984 study, examined 7-month outcomes. 

Study population: 

■ 100% Male 

■ 53% African American 

■ 47% White 

At 1-month followup, study found that anger coping 
groups were more effective in reducing aggressive 
and disruptive off-task behaviors as an intervention 
than either a behavioral program with goal setting 
or a control group. 

High levels of on-task behavior maintained; 
disruptive behavior reductions not maintained. 

Lochman, Lampron, 
Gemmer, & Harris 
(1989). In Fonagy 
et al, (2005); 

Lochman (1992). 

In Fonagy et al., 
(2005) 

Randomized control trial with youth (n = 32, ages 9-13) assigned to one 
of three groups: coping power intervention with teacher consultation, coping 
power intervention, regular, or control group. 

Both treatment groups superior to control group: 
however, there was no significant difference between 
treatment groups. 

3-year followup study demonstrated a reduction 
in substance abuse use and alcohol use compared 
to untreated boys. As well, booster sessions 
significantly contributed to maintenances of reduced 
off-task behavior. 
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Table 14: Coping Power: Research Base and Outcomes 


Reference Research Design and Sample* 

Outcomes 


Lochman & Wells Randomized control trial examining the post-intervention and 1-year 
(2002b; 2003) followup effects of Coping Power. Aggressive children (n = 245, grades 

5th and 6th) were randomly assigned to Coping Power, Coping Power 
plus a universal intervention (Coping with the Middle School Transitions), 
the universal intervention alone, or a control group. 

Study population: 

■ 66% Male 

■ 34% Female 

■ 78% African American 

■ 21% White 

■ Less than1% Hispanic 


Coping Power intervention demonstrated significant 
preventive effects in children's substance use, 
reductions in proactive aggression, improved social 
competence, and greater teacher-rated behavioral 
improvement at intervention's end in comparison 
to control group. (Lochman & Wells, 2002b). 

The 1-year followup effects were replicated in 
a second sample, as Coping Power produced 
reductions in delinquency, substance use, and 
aggressive behavior relative to two comparison 
conditions (Lochman & Wells, 2003). 


van de Weil, 
Matthys, Cohen- 
Kettenis, & van 
Engeland, (2003); 
van de Weil, 
Matthys, Cohen- 
Kettenis, Maassen, 
Lochman, & van 
Engeland (In press); 
Zonnevylle-Bender, 
Matthys, van de 
Wiel, & Lochman 
(2007). 


Randomized control trial of children (n = 77, ages 8-13 years) with ODD 
or CD in outpatient treatment, randomly assigned to either Dutch adaptation 
of Coping Power (UCPP: Utrecht Coping Power Program) or to care as usual. 
Study population: 

■ 88% Male 

■ 12% Female 

■ 100% Dutch 


The Dutch adaptation of Coping Power (Utrecht 
Coping Power Program) has produced cost-effective 
postintervention effects on children's aggressive 
behaviors, and has produced significant reductions 
in substance use at a 4-year followup, in comparison 
to care-as-usual. 


Lochman & Wells Experimental design to test the effectiveness of Coping Power and its 
(2004) sustained effects after 1 year. 4th and 5th grade boys (n = 183) screened 

for aggression who met criteria randomly assigned to the child-intervention 
only group, child plus parent intervention group, or the control group. 
Study population: 

■ 100% Male 

■ 61% African American 

■ 38% White 

■ 1 % Other 


At 1-year followup, study indicated that boys in 
child intervention plus parent group had lower 
rates of self-reported covert delinquent behavior. 
Boys who received coping power intervention 
demonstrated increased behavioral improvements 
during the academic year following treatment, 
as indicated by teacher reports. 

Coping Power demonstrated clearer effects on 
Caucasian boy's parent-rated substance abuse use 
and school behavior functioning than seen for 
minority children parent ratings; most minority 
children were African American. However, covert 
delinquency outcomes produced equivalent effects 
for minority and Caucasian children. 


Lochman, Randomized control trial evaluating an abbreviated version of Coping 

Boxmeyer, Powell, Power (24 child sessions; 10 parent sessions) with aggressive boys and girls 

Roth, & Windle (n = 240) assigned to Coping Power intervention group or to the control 

(2006) condition. 

Study population: 

■ 64% Male 

■ 36% Female 

■ 69% African American 

■ 30% White 

■ 1% Other race or ethnicity 


The abbreviated version of Coping Power produced 
significant postintervention effects on children's 
externalizing behavior problems. 


’ Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

■ There is no formalized process for assessing a 
site’s readiness to implement the program. The 
developers conduct telephone screens to assess 
a site’s willingness and ability to implement, but 
use no instrument. 

■ According to Dr. Lochman, a key issue in 
deciding to work with a site is its willingness 
to do some type of evaluation after staff have 
received the training. 

■ There is no readiness assistance to those sites 
that may not have the full capacity to implement 
their program. 


Training/coaching and materials 

■ Usually, Dr. Lochman and a doctoral-level 
researcher travel to sites to conduct a 3-day 
workshop. 

■ The 3-day workshop covers the background 
and development of the program and reviews 
the empirical findings of Coping Power. 

■ Monthly consultations are included in the costs. 
These are conference calls that usually last 60 to 
90 minutes and may occur more frequently than 
once a month depending on the agreement with 
the site. 

■ Training materials have been translated 
in Dutch and Spanish. 

Information on training and 

materials can be obtained at: 

http://www.bama.ua.edu/~lochman/index2.htm 


Cost of training/consulting 

The cost for training is approximately $5,000 
plus travel expenses and material costs. 


Developer involvement 

The developers are currently involved in the 
program. Currently an informal group offers the 
training and consultation services. Those wishing 
to learn more about training services should 
contact Dr. Nicole Powell or Dr. Lochman 
directly through email or phone. 

Nicole Powell, Ph.D. 

Department of Psychology 
University of Alabama 
348 Gordon Palmer 
P0 Box 870348 
Tuscaloosa, AL 35487 
Phone: (205) 348-3535 
Email: npowell@as.ua.edu 

John Lochman, Ph.D. 

Department of Psychology 
University of Alabama 
348 Gordon Palmer 
PO Box 870348 
Tuscaloosa, AL 35487 
Phone: (205) 348-7678 
Fax: (205) 348-8648 
Email: jlochman@as.ua.edu 


Monitoring fidelity and outcomes 

■ Developers ask that sites use an objectives 
checklist to ensure implementation of Coping 
Power as designed. Measures are self-reported 
by the staff. 

■ The Coping Power program does not require 
collection of outcome data from the sites, but 
encourages evaluation of outcomes. 


Financing the intervention 

■ Some sites use the Safe and Drug Free Schools 
funding to help finance the intervention. 

■ Other sites use local community funding 
and grant funding to help pay for the Coping 
Power program. 
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Resources/Links 

The Coping Power Web site: 

http://www.bama.ua.edu/~lochman/index2.htm 

Office and Juvenile Justice and 
Delinquency Prevention Model Programs: 

http://www.dsgonline.com/mpg 
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Mentoring 


Intervention Description 


Background 

Mentoring programs are the formal mechanisms 
for developing positive, supported, professional 
relationships between at-risk youth and caring 
adults. The process of mentoring holds the belief 
that when youth have the presence of a caring, 
available adult in youths lives, they are more likely 
to become successful adults themselves. (Jekielek, 
Moore, Hair, & Scarupa, 2002). 

While mentoring programs vary in structure and 
emphasis, overall, mentoring is an effective tool 
for positively effecting the development of youth 
(Jekielek et al., 2002). Two key organizations in 
the mentoring field are: 

■ MENTOR/The National Mentoring Partnership: 

An organization started in 1990 to support 
and encourage the efforts of new and existing 
mentoring programs by providing research, 
policy recommendations, and practical tools 
to help connect youth with mentors; it is the 
“mentors mentor” (http://www.mentoring.org). 

■ Big Brothers Big Sisters of America (BBBSA): 

The largest organized mentoring affiliation 
in the U.S. The Big Brother and Big Sister 
programs started in 1902 and became a united 
organization in 1977. Today, more than 500 
agencies work as partners of BBBSA under 
the shared mission statement that youth can 
become “confident, competent and caring 
individuals by providing committed volunteers, 
national leadership, and standards of excellence” 
(McGill, 1998, p. 13). 


Figure 1 5 


Mentoring 

Type of EBP 

■ Intervention 

Setting 

■ Home 

Age 

■ 6-18 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Increased confidence in school 
performance. 

■ Improved family relationships. 

■ Increased prosocial behaviors. 


Characteristics of the intervention 

Mentoring organizations are located in a number 
of settings: schools, communities, faith-based 
organizations, agencies, juvenile corrections, 
and on the Internet through e-mentoring. 

The characteristics of mentoring vary and 
include traditional one-on-one mentoring, group 
mentoring, team mentoring, peer mentoring, 
and e-mentoring (http://www.mentoring.org/start_a_ 
program/planning_and_design/). 

BBBSA is an example of a traditional one-on-one 
mentoring program with a strict, standard process 
that is clearly specified. Services start with a case 
manager, who often has a B.A. or M.A. in social 
work, and has the responsibility of following the 
life of the mentor-youth relationship. Services can 
be conceptualized in seven stages (McGill, 1998): 

■ Inquiry: An initial referral made to the agency 
on behalf of the youth or an initial contact from 
potential mentors. 

■ Orientation: Face-to-face contact between 
volunteers and program staff to determine 
if BBBSA fits a volunteer’s needs. 
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■ Volunteer screening: A written application, 
background check, written references, a 
psychosocial interview, and a home assessment, 
which may or may not include a home visit. 

■ Youth assessment: A written application, an 
interview with parent and child, and a home 
assessment to establish the goals for the 
mentor relationship. The case manager places 
information into a formal individualized case 
plan that is updated over time. 

■ Matching: Made based on needs of the youth, 
volunteers’ abilities, and considerations of 
program staff. 

■ Match supervision: Encouragement and support 
provided to aid in the effectiveness of the 
match. Contact consists of an initial conversation 
within the first 2 weeks of the match with the 
youth, the parent or guardian, and the mentor; 
monthly contact with all parties are held for the 
first year; and a written evaluation is prepared 
at the end of the first year. 

■ Closure: It is the responsibility of the case 
manager to officially close the relationship if 
either the youth or mentor decides they can no 
longer fully participate, or if the youth reaches 
the age of 18 years. 

Mentors commit to at least 1 year of volunteer 
service, with an average contact of 4 hours per 
mentor-youth meeting, three times a month. 
While the actual activities are not structured 
by BBBS, the mentor and youth participate in 
developmentally appropriate activities: taking a 
walk, playing catch, watching television, watching 
a sporting event, going to the library, or just 
hanging out (McGill, 1988). 


Research Base and Outcomes 

Even though mentoring programs have existed 
for more than 100 years, research that evaluates 
the benefits of these programs has appeared in 
the literature only for roughly the past 20 years 
(DuBois et al., 2002). A meta-analysis, conducted 
by DuBois et ah, (2002), reviewed 55 evaluations 
of mentoring programs. 

Favorable effects were found across age, gender, 
race, ethnicity, and family structure. The largest 
effect sizes were observed with youth at risk due 
to environmental conditions or disadvantage; no 
overall favorable effect was found, however, for 
youth at risk due to individual-level characteristics 
(that is, youth with significant personal problems). 

Besearch also supports the finding that the effects 
of a mentoring program are enhanced significantly 
by adherence to theory and empirically based 
“best practices.” (DuBois et ah, 2002). Table 15, 
Mentoring: Research Base and Outcomes , highlights 
outcomes from a longitudinal BBBSA study. 
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Table 15: Mentoring: Research Base and Outcomes 


Reference 

Research Design and Sample* 

Outcomes 

Tierney, Grossman, 

& Resch (1995); 

18-month study of adolescents (n = 959, 10-16 years) from eight BBBSA 
agencies, randomly assigned to a mentor or a waitlist. 

Compared to waitlist control group, mentored 
youth were: 

Grossman & Rhodes 
(2002) 

Study with the same sample above examined the effects and predictors 
of youth mentor relationships. 

Study population: 

■ 62% Male 

■ 38% Female 

■ 71 % African American 

■ 46% less likely to initiate drug use. 

■ 27% less likely to initiate alcohol use. 

■ Almost one-third less likely to hit someone. 

■ Skipped half as many school days. 

■ Felt more competent at schoolwork and showed 
improvement in grade point average. 


■ 18% Hispanic 

■ 11 % Other 

■ Displayed better relationships with their 
parents and peers at the end of the 18-month 
study period. 



Adolescents in relationships that lasted 1 year 
or longer reported the largest number of 
improvements, with progressively fewer effects 
emerging among youth who were in relationships 
that terminated earlier. 



Adolescents in relationships that terminated in 
less than 6 months reported decrements in several 
indicators of functioning. 



Older adolescents, as well as those referred for 
services, or those who had sustained emotional, 
sexual, or physical abuse were most likely to be 
in early terminating relationships. 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

Factors to consider during the planning process 

include the following (DuBois et ah, 2002): 

■ Recruitment of prospective mentors; 

■ Screening process of mentors to include 
background checks; 

■ Levels of training and supervision provided 
to mentors; 

■ Characteristics of the youth participants; 

■ Qualities of the mentor-youth relationships 
that are formed; and 

■ Assessment of the intervention. 

Recommended implementation practices: 

Recommended implementation practices include 

the following: 

■ The use of mentors with backgrounds in the 
helping professions (Dubois et ah, 2002). 

■ Ongoing training for mentors beyond initial 
training (Dubois et ah). 

■ Structured activities for mentors and youth 
(Dubois et ah). 

■ Appropriate framing of the mentor-youth 
relationship; time is needed for the relationship 
to form (Pryce, Kelly & Keller, 2007); realistic 
expectations but frequent, regular contact 
between the mentor and youth is needed 
(Dubois et al, 2002). 

■ Encouragement of parents to know the mentors 
and to be involved in supporting the relationship 
(Dubois et ah). 

■ Communication and collaboration among 
parent, mentors, and the agency (Pryce, Kelly, 

& Keller). 

■ Monitoring program implementation and 
adjusting the program accordingly (Dubois et al.). 


Components: 

■ Resources needed for implementing a mentor 
program include office space with privacy, a 
place for mentor training and for locked files, 
volunteer recruitment materials, liability 
insurance, and staffing. 

■ The National Mentoring Institute provides 
a Checklist for Program Progress: Program 
Design and Planning in Section IV of How 
to Build a Successful Mentoring Program 
Using the Elements of Effective Practice, 
available online (http://www.mentoring.org). 
This document outlines the process from 
pre-implementation to program evaluation. 

Startup: 

According to the BBBSA model, creating a new 

program takes roughly 1 year and includes the 

following (McGill 1998): 

■ An advisory board should be created with 
members of other local organizations who 
may be interested in BBBSA program in 
the community. 

■ A needs-assessment should be conducted, 
including a plan and timetable for 
implementation, to be drafted by the 
advisory board. 

■ The needs assessment is reviewed by the 
national staff. 

■ If a program is accepted, permission 
is granted to use BBBSA’s name for 
fundraising, startup costs; the site becomes 
an “Agency-in-formation.” 

■ When a site graduates to a “Provisional 
Member,” services are allowed to begin, 
following guidelines and standards. 

■ For the creation of a BBBSA mentoring 
program as a satellite office for an existing 
program, the local or national program should 
be contacted, and an advisory board would 
be formed (McGill, 1998). 
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■ Effective programs incorporate standard, 
recommended procedures in their operations 
(Pryce, Kelly, & Keller, 2007); program 
effectiveness increases in direct proportion 
to the number of specific program practices 
that are employed (DuBois et ah, 2002). 

Possible barriers: 

■ A limited number of adults to serve as mentors 
(Grossman & Garry, 1997). 

■ A scarcity of organizational resources necessary 
to carry out a successful program (Grossman & 
Garry, 1997). 


Training/coaching and materials 

■ Twenty-seven State Mentoring Partnerships 
offer training (http://www.mentoring.org/find_ 
resources/state_partnerships/). 

■ The National Mentoring Institute offers 
information on training opportunities 

(http://www.mentoring.org/events/) as well as 

online training for face-to-face mentoring 

(http://apps.mentoring.org/training/TMT/index.adp) 
or e-mentoring (http://www.Mentoring.org/emc). 

Extensive literature on program design and 
planning tools is also provided, including the 
downloadable document, How to Build a 
Successful Mentoring Program Using the 
Elements of Effective Practice. The document 
may be downloaded from this Web site in 
Spanish, (http://www.mentoring.org/downloads/ 
mentoring_418.pdf), 

■ BBBSA has developed a number of 2- and 
5-day Educational Institutes for training 
executive directors, middle managers, and 
case managers. A “train-the-trainer” program 
is offered by BBBSA for mentor training for 
local program staff. It consists of 10 2-hour 
modules on the topics of relationship-building, 
communication skills, and child development 
(McGill, 1998). Contact the national 
organization (http://www.bbbsa.org). 


Cost of training/consulting 

■ Training and consultation costs vary depending 
on the program. Some state programs are free. 
Other national conferences have a registration 
fee along with travel expenses. 

■ Extensive program design and planning tools 
are available for free on the National Mentor 
Institute’s Web site (http://www.mentoring.org). 

Specifically for BBBSA: 

■ Cost of the Educational Institutes is shared by 
the local organization and the national office; 
the local organization pays for travel expenses 
(McGill, 1998). 

■ Startup budget needed for an independent 
agency is $30,000 to $50,000; startup budget 
needed for a satellite program is $20,000 

to $40,000. 

■ An initial fee is paid to BBBSA for consultation 
and materials during the needs assessment 
process. An additional $3,000 fee is charged 

if the program becomes a Provisional Member. 


Developer involvement 

Contact the National Mentoring Partnership at: 

MENTOR/National Mentoring Partnership 
1600 Duke Street, Suite 300 
Alexandria, VA 22314 
Phone: (703) 224-2200 
http://www.mentoring.org 

Contact the Big Brothers Big Sisters of America’s 
National Office at: 

Big Brothers Big Sisters of America National Office 

230 North 13th Street 

Philadelphia, PA 19107 

Phone: (215) 567-7000 

Email: national@bbbsa.org 
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Monitoring fidelity and outcomes References 


■ The National Mentoring Institute supports 
monitoring outcomes. Section IV of How to 
Build a Successful Mentoring Program Using 
the Elements of Effective Practice provides 
information on program evaluation. (http://www. 
mentoring.org/downloads/mentoring_418.pdf). 

■ The BBBSA program outlines fidelity standards 
in Standards and Required Procedures for 
One-to-One Service. Standards are reinforced 
through training and conferences on the national 
and regional levels and agency evaluations. 
Adherence to the national standards is required 
for member affiliation (McGill, 1998). 


Financing the intervention 

■ The National Mentoring Institute provides 
information about how to develop a financial 
plan for diversified funding in Section V of 
the downloadable document How to Build 

a Successful Mentoring Program Using the 
Elements of Effective Practice (http://www. 
mentoring.org/downloads/mentoring_418.pdf). 

■ The U.S. Department of Education had a 
competition for funding under its Mentoring 
Programs grants through FY 2009 when $50 
million was available for funding. This program 
provided competitive grants to support school- 
based mentoring programs for children in need 
of assistance. The National Mentoring Institute 
will work to restore funding. 


Resources/links 

For more information on MENTOBING/ 

The National Mentoring Partnership, see 

http://www.mentoring.org. 

For more on Big Brothers Big Sisters of America, 

see http://www.bbbsa.org. 
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Multisystemic Therapy 


Intervention Description 


Background 

Multisystemic Therapy (MST) is an intensive 
family and community-based treatment for 
youth with serious conduct-related problems 
and substance abuse issues. It was developed in 
the late 1980s and early 1990s, and limited training 
in the model was provided by the Family Services 
Research Center (FSRC) of the Medical University 
of South Carolina, Department of Psychiatry and 
Behavioral Sciences. 

Since 1996, MST Services has been the university- 
licensed organization responsible for transporting 
and implementing MST to community sites. 

More than 350 MST teams are implementing 
the program throughout the United States and 
in nine other countries. 

A significant amount of the growth in MST 
programs has come through the 20+ MST 
“training organizations” known as MST Network 
Partners; see below under Training/coaching 
and Materials for more information about Network 
Partner organizations. 

MST Network Partners directly support transporting 
and implementing more than 250 of the existing 
350 teams. Teams are comprised of three to four 
therapists each carrying a caseload of four to six 
families and a clinical supervisor. 


Figure 16 


Multisystemic Therapy 

Type of EBP 

■ Intervention 

Setting 

■ Home 

■ School 

Age 

■ 12-18 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Decreased arrests and re-arrests. 

■ Increased school attendance. 

■ Decreased behavior problems. 

■ Decreased substance use. 


Characteristics of the intervention 

MST treatment is a multi-faceted family and 
community-based treatment for youth who 
are at imminent risk of out-of-home placement 
due to serious antisocial behavior and substance 
abuse problems. Intervention strategies integrate 
techniques from empirically supported treatments 
including the following: 

■ Structural and strategic family therapies; 

■ Parent management training; 

■ Marital therapies; 

■ Behavioral therapy; and 

■ Cognitive-behavioral therapy. 

Treatment sessions involve identifying strengths 
in the everyday contexts of the youth and family 
(for example, youth, family, peers, school, 
neighborhood, community) that can be used as 
levers for change to address the combination of 
known risk factors in those contexts that contribute 
to the youth s referral problems. 
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MST is delivered by trained masters level or highly 
experienced bachelor’s level therapists. Therapist 
implementation of MST is supported by model- 
specific training, onsite clinical supervision, and 
expert consultation from doctoral- or master’s- 
level people trained in MST. All therapists have a 
small caseload and are available to the family on a 
24-hour basis. 

The course of treatment ranges from 3 to 5 months. 
Treatment occurs in the family’s home and other 
locations (for example, school, neighborhood, mall, 
etc.) in which the youth’s problems occur and must 
be addressed. Therapists and families together 
develop and continuously revise interventions 
on the basis of observations of intervention success 
and failure, and plan how to address problem areas 
and goals for treatment. To measure and determine 
progress, the therapist and family set and review 
goals weekly. 

The main focus of MST is to cultivate among the 
youth’s caregivers the skills and naturally occurring 
resources to effectively address the challenges 
presented by the youth’s behavior problems. 

In school settings, the therapists work to facilitate 
a collaborative relationship between the school 
and parents needed to conjointly design strategies 
to improve identified performance and behavior 
problems at school. 

With respect to peers, therapists work with the 
youth’s caregivers and the caregivers of the youth’s 
peers to decrease association with delinquent and 
drug-involved friends and increase association with 
positive peers. 


The treatment of MST is guided by the 

nine MST principles (retrieved from 

http://www.mstservices.eom/text/treatment.html#nine): 

■ Comprehensive assessment to understand the 
child and family problems and functioning in 
relation to their broader systemic context. 

■ Therapeutic contacts emphasize the positive 
and use systemic strengths as levers for 
positive change. 

■ Interventions are designed to promote responsible 
behavior and decrease irresponsible behavior 
among family members. 

■ Interventions are present-focused and action- 
oriented, emphasizing specific and well-defined 
problems. 

■ Interventions focus on sequences of behavior 
within and between multiple systems that 
maintain the identified problems. 

■ Interventions are developmental^ appropriate 
and fit the developmental needs of the youth. 

■ Interventions are designed to require daily 
or weekly effort by family members in trying 
out new behaviors and ways of relating. 

■ Intervention effectiveness is evaluated 
continuously from multiple perspectives, with 
MST team members assuming accountability 
for overcoming barriers to successful outcomes. 

■ Interventions are designed to promote 
treatment generalization and long-term 
maintenance of therapeutic change. 
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Research Base and Outcomes 

Fifteen published studies on the effectiveness of 
the MST program were conducted between 1986 
and 2005. Of these 15 studies, 14 randomized 
control trials and one quasi-experimental design 
have demonstrated positive effects. 


Table 16 summarizes studies of MST that involved 
substance abusing and delinquent youths, and 
youth experiencing serious emotional disturbance 

(http://www.mstservices.com/text/research.html, 
retrieved 05/03/07). 


Table 16: Multisystemic Therapy: Research Base and Outcomes 

Reference 

Research Design and Sample* 

Outcomes 

Henggeler, Rodick, 

Borduin, Hanson, 

Watson, & Urey (1986) 

Quasi-experimental design study with delinquents (n = 57) MST 
comparison to diversion services. 

Study population: 

■ 84% Male 

■ 16% Female 

■ 65% African American 

■ 35% White 

At posttreatment, MST group improved family 
relations, decreased behavior problems, and 
decreased association with deviant peers. 

Henggeler, Borduin, 
Melton, Mann, Smith, 

Hall, Cone, £r Fucci 
(1991) 

Randomized control trial with adolescent (n = 200) who were 
serious juvenile offenders. MST compared to individual counseling 
and usual community services. 

Study population: 

■ 67% Male 

■ 33% Female 

■ 70% White 

■ 30% African American 

At 3 years, MST group demonstrated reduced 
alcohol and marijuana use and decreased drug- 
related arrests. 

Henggeler, Melton, & 
Smith (1992); 

Henggeler, Melton, 

Smith, Schoenwald, & 
Hanley (1993) 

Randomized control trial with violent and chronic juvenile 
offenders 

(n = 84). MST compared to usual community services. 

Studies population: 

■ 77% Male 

■ 26% Female 

■ 56% African American 

■ 42% White 

■ 2% Hispanic 

■ At 59 weeks, MST group improved family 
relations, improved peer relations, decreased 
recidivism (43%), decreased out-of-home 
placement (64%). 

■ At 2.4 years, MST group decreased recidivism 
(doubled survival rate). 

Borduin, Mann, Cone, 
Henggeler, Fucci, Blaske, 

& Williams (1995); 

Schaeffer & Borduin 
(2005) 

Violent and chronic juvenile offenders (n = 176). MST compared 
to individual counseling. 

Studies population: 

■ 68% Male 

■ 32% Female 

■ 70% White 

■ 30% African American 

■ At 4 years, MST group improved family relations, 
decreased psychiatric symptomatology, decreased 
recidivism (69%), decreased rearrests (54%). 

■ At 13.7 years MST group decreased days 
incarcerated (57%). 
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Table 16: Multisystemic Therapy: Research Base and Outcomes 


Reference 

Henggeler, Melton, 
Brondino, Scherer, & 
Hanley (1997) 


Henggeler, Rowland, 
Randall, Ward, Pickrel, 
Cunningham, Miller, 
Edwards, Zealberg, 

Hand, & Santos (1999); 
Schoenwald, Henggeler, 
Brondino, & Rowland 
( 2000 ); 

Huey, Henggeler, 
Rowland, Halliday- 
Boykins, Cunningham, 
Pickrel, & Edwards 
(2004); 

Henggeler, Rowland, 
Halliday-Boykins, 
Sheidow, Ward, Randall, 
Pickrel, Cunningham, & 
Edwards (2003); 

Sheidow, Bradford, 
Henggeler, Rowland, 
Halliday-Boykins, 
Schoenwald, & Ward 
(2004) 

Henggeler, Pickrel, & 
Brondino (1999); 

Schoenwald, Ward, 
Henggeler, Pickrel, & 
Patel (1996); 

Brown, Henggeler, 
Schoenwald, Brondino, 

& Pickrel (1999); 
Henggeler, Clingempeel, 
Brondino, & Pickrel 
( 2002 ) 


Ogden & Halliday- 
Boykins (2004); 

Ogden & Hagen 
(in press) 


Research Design and Sample* 

Randomized control trial with violent and chronic juvenile 
offenders 

(n = 155). MST compared to juvenile probation services - high 
rates of incarceration. 

Studies population: 

■ 82% Male 

■ 18% Female 

■ 81 % African American 

■ 19% White 

Randomized control trial with youths (n = 1 16, final sample n 
= 1 56) presenting psychiatric emergencies. MST compared to 
Psychiatric hospitalization. 

Studies population: 

■ 65% Male 

■ 35% Female 

■ 65% African American 

■ 38% White 

■ 1 % Other 


Randomized control trial with substance abusing and dependent 
delinquents (n = 118). MST compared to Usual community 
services. 

Studies population: 

■ 79% Male 

■ 21% Female 

■ 50% African American 

■ 47% White 

■ 1 % Asian American 

■ 1% American Indian 

■ 1% Hispanic 

Randomized control trial with Norwegian youths (n = 100) with 
serious antisocial behavior. MST compared to usual Child Welfare 
Services. 

Study population: 

■ 63% Male 

■ 37% Female 

■ 100% Norwegian 


Outcomes 

At 1.7 years, MST group decreased psychiatric 
symptomatology, decreased days in out-of-home 
placement (50%), decreased recidivism (26% not 
significant), treatment adherence linked with long¬ 
term outcomes. 


■ At 4 months postrecruitment: MST decreased 
externalizing problems (CBCF), improved family 
relations, increased school attendance, higher 
consumer satisfaction, 75% reduction in days 
hospitalized, 50% reduction in days in other 
out-of-home placement, decreased rates of 
attempted suicide. 

■ Favorable 4-month outcomes noted above 
dissipated. 


■ At 1 year: Decreased drug use at posttreatment, 
decreased days in out-of-home placement (50%), 
decreased recidivism (26%, not significant), and 
treatment adherence linked with decreased drug 
use. 

■ At 1 year: Incremental cost of MST nearly offset 
by between-groups, differences in out-of-home 
placement, increased attendance in regular 
school settings. 

■ At 6 months: Decreased violent crime. 

■ At 4 years: Increased marijuana abstinence. 


■ At 6-month postrecruitment, decreased 
externalizing and internalizing symptoms, 
decreased out-of-home placements, 
increased social competence and, increased 
consumer satisfaction, 

■ 18-month followup, decreased externalizing and 
internalizing symptoms; decreases in out-of-home 
placements. 
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Table adapted from http://www.mstservices.com/text/research.html, retrieved May 3, 2007. 
* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

A site assessment process guides the exploration 
of interested service systems, provider organizations, 
and communities concerning the needs for 
which MST is perceived as a possible solution, the 
demonstrated capacity of MST to meet those needs, 
and the readiness of the partners in implementation 
(that is, referral agencies, payers, provider agencies, 
consumers, MST Services or one of its Network 
Partners) to launch an MST program. 

Initial steps in the needs assessment process 
typically take place over the telephone and 
subsequent steps involve one or more site visits 
conducted by MST Services. The site visit is 
designed to include critical community stakeholders 
in the process of learning about the MST model, 
considering the extent to which identified service 
needs can be met by MST and determining the 
viability of implementing and sustaining MST 
services in the existing community practice context. 

Staffing: 

MST Services can provide selection criteria 
for staffing an MST program. In addition, MST 
Services offers protocols for supervisors and 
therapists that include sample job advertisements, 
initial screening criteria, and interview questions. 


Training/coaching and materials 

Training is available only to “licensed” MST 
programs. As a general rule, all trainings are 
held onsite except for orientation trainings 
for replacement staff, which are conducted 
in Charleston, South Carolina, as well as at 
designated Network Partner sites, such as those 
in Middletown, Connecticut; Denver, Colorado; 
and Latrobe, Pennsylvania. 


Training is conducted on certain dates; schedules 
are available through http://www.mstservices.com. 

The MST training curriculum consists of a 5-day 
orientation training, booster sessions every quarter, 
weekly onsite clinical supervision for treatment 
teams and supervisors, and weekly consultation 
from a doctoral- or master’s-level MST expert. 

In addition to these trainings are supervisor 
trainings and “advanced” supervisor training. 

Orientation training: 

The initial orientation training is 5 days long, 
and all service provider agency staff with clinical 
treatment and clinical supervisory responsibility 
for the youth and families treated in the MST 
program must attend all 5 days of training. 

Agencies collaborating in the development and 
support of the MST program are also invited 
and can also send key administrators or other 
stakeholders to learn about MST on the first day 
of the orientation training. The goal of the 5-day 
orientation training is for participants to become 
familiar with the strategies used in MST, to 
understand the causes of serious behavior problems 
in youth and how to treat those problems, and the 
theory and research behind the treatment. 

The clinical interventions focused on the family, 
peer group, school, and identified youth are 
discussed, and participants practice assessing 
the nature of the problems and strategies to begin 
to address them. Participants practice assessing 
clinical problems and delivering MST interventions 
in group exercises and role-plays. 

Quarterly booster sessions: 

As therapists gain field experience with MST, 
quarterly booster sessions are conducted onsite 
by the MST Expert assigned to work with the team 
for ongoing training and quality assurance. The 
purpose of these 1.5-day boosters is to provide 
additional training in areas identified by therapists 
(for example, marital interventions, treatment of 
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parental depression in the context of MST) and 
to facilitate indepth examination, enactment, and 
problem-solving of particularly difficult cases. 

Weekly calls: 

Weekly phone consultation is provided for each 
treatment team (therapists and supervisor) by 
their assigned MST Expert. Consultation sessions 
focus on promoting adherence to MST treatment 
principles, developing solutions to difficult clinical 
problems, and designing plans to overcome any 
barriers to obtaining strong treatment adherence 
and favorable outcomes for youths and families. 

As noted earlier, high treatment adherence is critical 
to obtaining favorable long-term outcomes for 
serious juvenile offenders, and, as such, the central 
goal of the training and consultation process is to 
maximize adherence to the MST principles. 

Supervisor orientation training: 

■ Training is offered on select dates in Charleston, 
South Carolina. 

■ This training is offered for supervisors during 
the first 6 months of performing the job. 
Training is highly interactive and helps 
supervisors practice their skills. In addition, 
supervisors identify their strengths and 
weaknesses in areas of clinical development, 
community collaboration, group supervision, 
and hiring. 

Advanced supervisor training: 

This level of training is offered only once a year in 
Charleston, South Carolina. It is designed for those 
supervisors who have been in their position 6 
months or more. Three different topical areas are 
addressed at least once a year: 

■ Group supervision; 

■ Clinician development; and 

■ Program continuous quality improvement 
management. 


Network partners and the 
train-the-trainer approach: 

MST has a train-the-trainer approach. When 
certain conditions allow (for example, scale of 
implementation, adherent implementation, etc.), 
an MST training organization can be developed 
with the support of MST Services. Such 
organizations are called MST Network Partners. 

This network of organizations is committed to the 
transport of the MST model with full integrity and 
fidelity. It is a key to the transport strategy 
employed by MST Services. 

MST Network Partner organizations employ staff 
fully trained in MST program development as well 
as clinical staff training and development and 
quality assurance monitoring. MST Services 
maintains an ongoing working relationship with 
each MST Network Partner organization, focused 
on staff development, quality improvement, and 
quality assurance activities. 

Network Partners are able to offer training 
to new sites and communities. More than 20 
network partner organizations directly support 
over two-thirds of the MST teams operating 
around the world. For a list of MST Network 
Partners, see the MST Services Web site: 
http://www.mstservices.com/text/network%20partners.htm. 

Manualization: 

Several manuals are available for implementing 
different aspects of MST. 

Henggeler, S. W., & Schoenwald, S. K. (1998). 

MST Supervisory Manual. New York: 

Guilford Press. 

Henggeler, S. W., Schoenwald, S. K., Borduin, 

C. M., Rowland, M. D., & Cunningham, 

P. B. (1998). Multisystemic treatment of 
antisocial behavior in children and adolescents. 
Treatment manuals for practitioners. New York: 
Guilford Press. 
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Henggeler, S. W., Schoenwald, S. K., Rowland, 

M. D., & Cunningham, P. B. (2002). 

Serious emotional disturbance in children and 
adolescents: Multisystemic Therapy. New York: 
Guilford Press. 

Schoenwald, S. K. (1998). Multisystemic Therapy 
Consultation Manual. New York: Guilford Press. 

Strother, K. B., Swenson, M. E., & Schoenwald, S. 
K. (1998). Multisystemic Therapy Organization 
Manual. Charleston, SC: MST Institute. 

For information on training and materials, go to 

http://www.mstservices.com. 


Cost of training/consulting 

Costs can depend on how many MST teams a site 
chooses to create. A team usually involves three to 
five staff members, including the team supervisor. 
It would cost approximately $26,000 for a single 
team to become trained and receive ongoing 
support. At a larger scale of implementation, these 
costs can decline to as low as $17,000 per team. 
However, other costs are not included in this price, 
such as licensing fees of $4,000 per agency and 
other per diem and travel costs for staff to receive 
the initial training or advanced training. 

When viewed as a part of the cost of services to 
clients, the total cost of all training, licensure, and 
travel range from $500 per youth treated to $300 
per youth treated depending on the scale of the 
MST system being supported. 

Additionally, when a system has developed its own 
MST Network Partner infrastructure, almost till of 
the above costs are internal to the system itself in 
the form of salaries paid to staff and associated 
staff support costs. 


Developer involvement 

The developers of MST are not directly involved 
in the transport and implementation of MST, 
although the protocols for treatment, clinical 
supervision, and expert consultation they designed 
form the basis for the training procedures and 
materials used in such transport. 

MST Services is the university-licensed company 
responsible for the transfer of MST technologies 
to community settings, and thus responsible for 
supporting the transport and implementation 
of MST. The MST model developers oversee the 
work of MST Services through their involvement 
on its Board of Directors. 

MST Network Partner organizations employ staff 
fully trained in MST program development, clinical 
staff training and development, and quality assurance 
monitoring. MST Services maintains an ongoing 
working relationship with each MST Network 
Partner organization focused on staff development, 
quality improvement and quality assurance activities. 


Monitoring fidelity and outcomes 

MST Services requires that sites submit fidelity 
data through a secured Internet-based data 
collectionsite at http://www.mstinstitute.org. 

In addition to the submission of fidelity data, 
sites submit their outcome data through 

http://www.mstinstitute.org. 


Financing the intervention 

Many sites pursue funding for MST through 
various child human service systems, often juvenile 
justice or child welfare. 

Medicaid may provide reimbursement for some 
components of MST. 
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Resources/Links 

http://www.mstservices.com 

http://www.mstinstitute.org 

University of Colorado Center for the 
Study and Prevention of Violence: 

http://www.colorado.edu/cspv/ 


References 

Blaske, D. M., Borduin, C. M., Henggeler, S. W., 

& Mann, B. J. (1989). Individual, family, and 
peer characteristics of adolescent sex offenders 
and assaultive offenders. Developmental 
Psychology, 25, 846-855. 

Borduin, C. M., Henggeler, S. W., Blaske, D. M., 

& Stein, B. (1990). Multisystemic treatment of 
adolescent sexual offenders. International 
Journal of Offender Therapy and Comparative 
Criminology, 35, 105-113. 

Borduin, C. M., Mann, B. J., Cone, L. T., et ah, 
(1995). Multisystemic treatment of serious 
juvenile offenders: Long-term prevention of 
criminality and violence. Journal of Consulting 
and Clinical Psychology, 63, 569-578. 

Borduin, C. M., & Schaeffer, C. M. (2002). 
Multisystemic treatment of juvenile sexual 
offenders: A progress report .Journal of 
Psychology 6- Human Sexuality, 13, 25-42. 

Brown, T. L., Henggeler, S. W., Schoenwald, S. K., 
et ah, 1999). Multisystemic treatment of substance 
abusing and dependent juvenile delinquents: 
Effects on school attendance at posttreatment and 
6-month follow-up. Children’s Services: Social 
Policy, Research, and Practice, 2, 81-93. 

Brunk, M., Henggeler, S. W., & Whelan, J. P. 
(1987). Comparison of multisystemic therapy 
and parent training in the brief treatment of 


child abuse and neglect. Journal of Consulting 
and Clinical Psychology, 55, 171-178. 

Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). 
Effective treatment for mental disorders in 
children and adolescents. Clinical Child and 
Family Psychology Review, 2, 199-254. 

Center for Substance Abuse Prevention (CSAP). 
(2000). Strengthening America’s families: 

Model family programs for substance abuse 
and delinquency prevention. Salt Lake City, 

Utah: Department of Health Promotion and 
Education, University of Utah. 

Cunningham, P. B., Naar-King, S., Ellis, D. A., 
Pejuan, S., & Secord, E. (2006). Achieving 
adherence to antiretroviral medications for 
pediatric HIV disease using an empirically 
supported treatment: A case report. Journal 
of Developmental and Behavioral Pediatrics, 

27, 44-50. 

Curtis, N. M., Bonan, K. B., & Borduin, C. M. 
(2004). Multisystemic treatment: A meta-analysis 
of outcome studies. Journal of Family 
Psychology, 18, 41 1 —411). 

Ellis, D. A., Frey, M. A., Naar-King, S., et ah, 
(2005). Use of multisystemic therapy to improve 
regimen adherence among adolescents with type 
1 diabetes in chronic poor metabolic control: A 
randomized controlled trial. Diabetes Care, 28, 
1604-1610. 

Ellis, D. A., Frey, M. A., Naar-King, S., et ah, 

(in press). The effects of multisystemic therapy 
on diabetes stress in adolescents with chronically 
poorly controlled type 1 diabetes: Findings from 
a randomized controlled trial. Pediatrics, 28, 
1604-1610. 

Ellis, D. A., Naar-King, S., Cunningham, P. B., 

& Secord, E. (2006). Use of multisystemic 
therapy to improve antiretroviral adherence 
and health outcomes in HIV-infected pediatric 
patients: Evaluation of a pilot program. AIDS, 
Patient Care, and STD’s, 20, 112-121. 


Evidence-Based and Promising Practices 


103 





Ellis, D. A., Naar-King, S., Frey, M. A., et al., 
(2003). Case study: Feasibility of multisystemic 
therapy as a treatment for urban adolescents 
with poorly controlled type 1 diabetes. Journal 
of Pediatric Psychology, 28, 287-293. 

Ellis, D. A., Naar-King, S., Frey, M. A., et ah, 
(2005). Multisystemic treatment of poorly 
controlled type 1 diabetes: Effects on medical 
resource utilization. Journal of Pediatric 
Psychology, 30, 656-666. 

Farrington, D. P., & Welsh, B. C. (1999). 
Delinquency prevention using family-based 
interventions. Children & Society, 13, 287-303. 

Halliday-Boykins, C. A., Schoenwald, S. K., & 
Letourneau, E. J. (2005). Caregiver-therapist 
ethnic similarity predicts youth outcomes from 
an empirically based treatment. Journal of 
Consulting b Clinical Psychology, 73 (5), 
808-818. 

Henggeler, S. W. (1993). Multisystemic treatment 
of serious juvenile offenders: Implications for 
the treatment of substance abusing youths. In L. 
S. Onken, J. D. Blaine, & J. J. Boren (Eds.), 
Behavioral treatments for drug abuse and 
dependence: National Institute on Drug Abuse 
Research Monograph 137 (pp. 181-200). 
Rockville, MD: NIH Publication No. 93-3684. 

Henggeler, S. W., Borduin, C. M., Melton, G. B., 
et ah, (1991). Effects of multisystemic therapy 
on drug use and abuse in serious juvenile 
offenders: A progress report from two outcome 
studies. Family Dynamics of Addiction 
Quarterly, 1, 40-51. 

Henggeler, S. W., Clingempeel, W. G., Brondino, 
M. J., & Pickrel, S. G. (2002). Four-year follow¬ 
up of multisystemic therapy with substance- 
abusing and substance dependent juvenile 
offenders. Journal of the American Academy 
of Child b Adolescent Psychiatry, 41, 868-874. 


Henggeler, S. W., Halliday-Boykins, C. A., 
Cunningham, P. B., et al., (2006). Juvenile 
drug court: Enhancing outcomes by integrating 
evidence-based treatments. Journal of 
Consulting and Clinical Psychology, 74, 42-54. 

Henggeler, S. W., Melton, G. B., Brondino, M. J., 
et til., (1997). Multisystemic therapy with violent 
and chronic juvenile offenders and their families: 
The role of treatment fidelity in successful 
dissemination. Journal of Consulting and 
Clinical Psychology, 65, 821-833. 

Henggeler, S. W., Melton, G. B., & Smith, L. A. 
(1992). Family preservation using multisystemic 
therapy: An effective alternative to incarcerating 
serious juvenile offenders. Journal of Consulting 
and Clinical Psychology, 60, 953-961. 

Henggeler, S. W., Melton, G. B., Smith, L. A., et 
al., (1993). Family preservation using multisystemic 
treatment: Long-term follow-up to a clinical trial 
with serious juvenile offenders. Journal of Child 
and Family Studies, 2, 283-293. 

Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. 
(1999). Multisystemic treatment of substance- 
abusing and -dependent delinquents: Outcomes, 
treatment fidelity, and transportability. Mental 
Health Services Research, 1, 171-184. 

Henggeler, S. W., Rodick, J. D., Borduin, C. M., 
et al., (1986). Multisystemic treatment of 
juvenile offenders: Effects on adolescent 
behavior and family interaction. Developmental 
Psychology, 22, 132-141. 

Henggeler, S. W., Rowland, M. D., Halliday- 
Boykins, C., et al., (2003). One-year follow-up 
of multisystemic therapy as an alternative to the 
hospitalization of youths in psychiatric crisis. 
Journal of the American Academy of Child b 
Adolescent Psychiatry, 42, 543-551. 


104 


Evidence-Based and Promising Practices 



Henggeler, S. W., Rowland, M. R., Randall, J., et 
al., (1999). Home-based multisystemic therapy 
as an alternative to the hospitalization of youth in 
psychiatric crisis: Clinical outcomes. Journal of 
the American Academy of Child H Adolescent 
Psychiatry, 38, 1331-1339. 

Henggeler, S. W., Sehoenwald, S. K., Liao, J. G., 
et al., (2002). Transporting efficacious treatments 
to field settings: The link between supervisory 
practices and therapist fidelity in MST programs. 
Journal of Clinical Child <Lr Adolescent 
Psychology, 31 , 155-167. 

Huey, S. J., Henggeler, S. W., Rrondino, M. J., 

& Pickrel, S. G. (2000). Mechanisms of change 
in multisystemic therapy: Reducing delinquent 
behavior through therapist adherence and 
improved family and peer functioning. Journal 
of Consulting and Clinical Psychology, 68, 
451_467. 

Huey, S. J. Jr., Henggeler, S. W., Rowland, M. D., 
et al., (2004). Multisystemic therapy effects on 
attempted suicide by youth presenting psychiatric 
emergencies .Journal of the American Academy 
of Child 6- Adolescent Psychiatry, 43, 183-190. 

Jones, H. E., Wong, C. J., Tuten, M., & Stitzer, M. 
L. (2005). Reinforcement based therapy: 
12-month evaluation of an outpatient drug-free 
treatment for heroin abusers. Drug and Alcohol 
Dependence, 79, 119-128. 

Kazdin, A. E., & Weisz, J. R. (1998). Identifying 
and developing empirically supported child and 
adolescent treatments. Journal of Consulting and 
Clinical Psychology, 66, 19-36. 

National Alliance for the Mentally Ill. (Fall, 2003). 
NAMI Beginnings. A Publication Dedicated to 
the Young Minds of America from the NAMI 
Child and Adolescent Action Center [Quarterly 
publication] .Arlington, VA: Author. Available 
from http://nami.org/. 


National Institute on Drug Abuse. (2009). 
Principles of drug addiction treatment: 

A research-based guide. NIH Publication 
No. 09-4180. Rockville, MD: Austhor 
(Revised edition) 

National Institutes of Health. (2004). Preventing 
violence and related health-risking social 
behaviors in adolescents: An NIH State-of-the- 
Science Conference. Rethesda, MD. 

National Mental Health Association. (2004). 

Mental health treatment for youth in the juvenile 
justice system: A compendiu m of promising 
practices. Alexandria, VA: Author. 

Ogden, T., & Hagen, K. A. (2007). Multisystemic 
therapy of serious behavior problems in youth: 
Sustainability of therapy effectiveness two years 
after intake. Child and Adolescent Mental 
Health, 11 (3), 142-149. 

Ogden, T., & Halliday-Roykins, C. A. (2004). 
Multisystemic treatment of antisocial adolescents 
in Norway: Replication of clinical outcomes 
outside of the U.S. Child and Adolescent Mental 
Health, 9(2), 77-83. 

Petry, N. M. (2000). A comprehensive guide 
to the application of contingency management 
procedures in clinical settings. Drug and Alcohol 
Dependence, 58, 9-25. 

Presidents New Freedom Commission on 
Mental Health (2003). Achieving the promise: 
Transforming mental health care in America 
— Final Report. Rockville, MD: U.S. 
Department of Health and Human Services. 

Roozen, H. G., Boulogne, J. J., van Tulder, M. W., 
et al., (2004). A systematic review of the 
effectiveness of the community reinforcement 
approach in alcohol, cocaine and opioid addiction. 
Drug and Alcohol Dependence, 74 (1), 1-13. 


Evidence-Based and Promising Practices 


105 




Rowland, M. R., Halliday-Roykins, C. A., 
Henggeler, S. W., et al., (2005). A randomized 
trial of multisystemic therapy with Hawaii’s Fehx 
Class youths .Journal of Emotional and 
Behavioral Disorders, 13, 13-23. 

Schaeffer, C. M., & Rorduin, C. M. (2005). Long¬ 
term follow-up to a randomized clinical trial of 
multisystemic therapy with serious and violent 
juvenile offenders .Journal of Consulting and 
Clinical Psychology, 73 (3), 445-M53. 

Schoenwald, S. K., Ilalliday-Boykins, C. A., & 
Henggeler, S. W. (2003). Client-level predictors 
of adherence to MST in community service 
settings. Family Process, 42, 345-359. 

Schoenwald, S. K., Henggeler, S. W., Rrondino, M. 
}., & Rowland, M. D. (2000). Multisystemic 
therapy: Monitoring treatment fidelity Family 
Process 39, 83-103. 

Schoenwald, S. K., Letoumeau, E. }., & Halliday- 
Roykins, C. (2005). Predicting therapist 
adherence to a transported family-based 
treatment for youth .Journal of Clinical Child 
and Adolescent Psychology, 34, 658-670. 

Schoenwald, S. K., Sheidow, A. J., & Letourneau, 
E. J. (2004).Toward effective quality assurance 
in evidence-based practice: Links between 
expert consultation, therapist fidelity, and child 
outcomes .Journal of Clinical Child and 
Adolescent Psychology, 33, 94-104. 

Schoenwald, S. K., Sheidow, A. J., Letoumeau, 

E. J., & Liao, J. G. (2003). Transportability of 
multisystemic therapy: Evidence for multilevel 
influences. Mental Health Services Research, 5, 
223-239. 

Schoenwald, S. K., Ward, D. M., Henggeler, S. W„ 
Pickrel, S. G., & Patel, H. (1996). Multisystemic 
therrapy treatment of substance abusing or 
dependent adolescent offenders: Costs of 
reducing incarceration, inpatient, and residential 
placement. Journal of Child and Family Studies, 
5, 431-M44. 


Schoenwald, S. K., Ward, D. M., Henggeler, S. W., 
& Rowland, M. D. (2000). MST vs. 
hospitalization for crisis stabilization of youth: 
Placement outcomes 4 months post-referral. 
Mental Health Services Research, 2, 3-12. 

Sheidow, A. }., Rradford, W. D., Henggeler, S. 

W., et al., (2004). Treatment costs for youths 
in psychiatric crisis: Multisystemic therapy 
versus hospitalization. Psychiatric Services, 55, 
548-554. 

Sheidow, A. }., & Henggeler, S. W. (2003). 
Multisystemic therapy with substance using 
adolescents: A synthesis of research. In N. 
Jainchill (Ed.), Understanding and treating 
adolescent substance use disorders. Kingston, 

NJ: Civic Research Institute. 

Stanton, M. D„ & Shadish, W. R. (1997). 

Outcome, attrition, and family-couples 
treatment for drug abuse: A meta-analysis and 
review of the controlled, comparative studies. 
Psychological Bulletin, 122, 170-191. 

Timmons-Mitchell, J., Render, M.R., Kishna, M.A., 
& Mitchell, C.C. (2006). An independent 
effectiveness trial of multisystemic therapy with 
juvenile justice youth .Journal of Clinical Child 
and Adolescent Psychology, 35, (2), 227-236. 

U.S. Department of Health and Human Services 
(1999). Mental health: A report of the Surgeon 
General. Rockville, MD: U.S. Department of 
Health and Human Services, National Institutes 
of Health. National Institute of Mental Health. 

U.S. Public Health Service (2001). Youth violence: 
A report of the Surgeon General. Washington, 
DC: Author. 

Van Wijk, A., Loeber, R., Vermeiren, R., et al., 
(2005). Violent juvenile sex offender compared 
with violent juvenile nonsex offenders: 
Explorative findings from the Pittsburgh Youth 
Study. Sexual Abuse, A Journal of Research and 
Treatment, 17, 333-352. 


106 


Evidence-Based and Promising Practices 




Functional Family Therapy 


Intervention Description 


Background 

Functional Family Therapy (FFT) is an empirically 
based clinical system that focuses on youth who 
are at risk of, or currently displaying, aggressive 
behavior, violence, and substance-use. 

FFT has been in existence for more than 30 years 
with well-documented results. It was originally 
developed by James Alexander, Pli.D., and Bruce 
Parsons, Pli.D., of the University of Utah. 

More than 50 percent of the current practices 
of FFT are implemented in the juvenile justice 
system. However, FFT can be offered in a variety 
of settings: mental health, schools, child welfare, 
probation, parole/aftercare, and as an alternative 
to incarceration or out-of-home placement. 


■ Reducing the personal, societal, and economic 
consequences that can result from various 
disruptive behaviors of youth; and 

■ Offering this intervention at lower cost, 
in terms of time and money as compared 
to more expensive treatment. 


Figure 17 


Functional Family Therapy 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

■ Home 

■ Juvenile Court 

Age 

■ 11-18 

Gender 

■ Males 

■ Females 

Training/Materials Available 

■ Yes 

Outcomes 

■ Reduction in recidivism. 

■ Reduction in out-of-home 
placements. 


Characteristics of the intervention 

FFT is a short-term therapy designed for male 
and female youth ages 11 to 18 years. The 
youth must be part of a psychosocial system that 
constitutes a family and not currently have active 
homicidal or suicidal ideation, nor substance use 
that requires detoxification. 

The three main goals that are fundamental to the 
success of the program are (Alexander et ah, 2002): 

■ Changing maladaptive behaviors of youth 
and relational dynamics of families, especially 
ones that may not be motivated to change; 


The program is implemented on average in 8 to 12 
1-hour sessions. However, for more challenging 
cases, longer duration of treatments may be needed. 

The program is designed to be administered by 
licensed professionals with a master’s degree or 
paraprofessionals who are highly supervised by a 
master’s-level clinician. FFT can be implemented 
in a home, clinic, or juvenile court program. It must 
be implemented in sequential phases, each 
of which has its own assessment process and 
intervention components. 
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Engagement and Motivation: 


Research Base and Outcomes 


This phase is concerned particularly with family 
member’s expectations about treatment and 
positive effects resulting from treatment. Clinicians 
identify and assess protective and risk factors. 

They also help label the cognitive, behavioral, 
and emotional expectations of each family member. 

Cognitive therapy techniques are used to help 
replace negative or maladaptive attributions 
such as hopelessness and lack of motivation, 
with positive ones. 

Behavior change: 

Various behavioral techniques are applied 
during this phase, such as cognitive reframing, 
communication skills training, and contingency 
management. In this phase, the therapist is 
modeling, labeling, and directing positive 
behavioral change. 

Generalization: 

In this phase, the clinician’s job is to sustain the 
momentum of change as well as to foster family 
independence from therapy. If families are 
involved in multiple systems, clinicians help 
the family address these various systems, such 
as school and legal. 

Throughout the intervention, interpersonal 
interactions among family members are assessed 
and addressed to improve family functioning. 


The efficacy of FFT has been supported by 29 
years of evaluation. Fourteen studies between 1973 
andl998 included primarily matched and randomly 
assigned comparison/control groups, with followup 
periods of 1, 2,3, and 5 years (Alexander et al., 2002). 

FFT has been implemented in rural and urban 
settings, and with families from diverse racial/ 
ethnic groups, including Caucasian, African 
American, Asian American, Hispanic/Latino, 
and American Indian. (Diverse populations were 
primarily included in replication studies). As of 
2002, the developers noted recidivism rates did 
not vary across ethnic/racial groups, supporting 
the generalizability of the intervention (Alexander 
et al., 2002). 

In addition, research from the Washington State 
Institute for Public Policy 2004 report on the 
cost effectiveness of evidence-based practices 
for prevention and intervention provides support 
for FFT; in 2003, the national rate net benefit over 
costs per child was $26,216, or $13.25 per day 
(Aos et al., 2004). 

Included in Table 17 is a sample of the studies that 
demonstrate positive outcomes across varied group 
participants (Alexander et al., 1998). 
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Table 17: Functional Family Therapy: Research Base and Outcomes 


Reference 

Research Design and Sample* Outcomes 

Alexander (1971); 

Alexander & Barton 
(1976; 1980) 

RCT of 40 adolescent (ages 13-16 years) delinquents arrested and detained FFT and FFT + Individual Therapy produced 

for runaway, ungovernable, or habitually truant randomly assigned to one significantly greater improvements in 

of four groups: communication style (less defensive, hostile, and 

■ FFT + Individual Therapy submissive communication) than other conditions. 

■ FFT only, 

■ Individual Therapy only, or 

■ Control Group with minimum attention from a probation officer. 

Study population: 

■ Predominately White 

Alexander & 

Parsons (1973) 

Adolescents (n = 99, ages 13-16) arrested and detained for running FFT group demonstrated significant improvements 

away, declared ungovernable or habitually truant, randomly assigned in family interactions compared to all other groups, 

to one of 4 groups: 

■ FFT, 

■ Client-Centered Family Therapy, 

■ Eclectic psychodynamic family therapy, 

■ Nontreatment control group. 

Study population: 

■ 44% Male 

■ 56% Female 

■ Predominately White 

Regas & Sprenkle 
(1982) from 
Alexander (2002) 

Adolescents (n = 55) diagnosed with ADHD, referred to child protective Positive increases in family concept of FFT group; 

services randomly assigned to one of three groups, both treatment groups demonstrated significant 

B ppy improvements on ADHD behaviors at home and 

at school. 

■ Group therapy, or 

■ No treatment control group. 

Friedman (1989) 

Adolescent drug abusers (n = 166, mean age = 17.8) randomly assigned FFT group demonstrated greater parental 

to one of two groups: involvement and lower family dropout rate. 

■ FFT or 

■ parent group. 

Study population: 

■ 60% Male 

■ 40% Female 

■ 89% White 

■ 11% Nonwhite 

Hannson (1998) 
from Alexander 
(2002) 

2-year study of Swedish Adolescents (n = 95) referred following arrest for Reduced maternal depression, somatization, 

serious offenses, randomly assigned to one of two groups: FFT or social and anxiety in FFT group, 

service as usual. 

Study population: 

■ Predominantly male 

■ 100% Swedish 


* Study sample's gender and race/ethnicity data provided when available. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

Before implementation, FFT, LLC (the 
dissemination organization of FFT) undertakes 
a formalized assessment process for determining 
sites’ ability to implement the program. It can 
be in the form of conference calls, reviewing 
applications for funding of FFT, and in-house 
discussions with sites. 

A 1-day stakeholder meeting is held at the site 
with site representatives and informal discussions 
with therapists. There is flexibility in assisting sites 
with adopting FFT. 

Through the initial readiness assessment, FFT Inc. 
works to gain buy-in. Depending on the community, 
consumers are sometimes involved in the decision 
to adopt the program. 

Staff selection: 

Developers have mock interview questions to help 
agencies choose the therapists to implement the 
program. Many agencies modify the interview 
questions that are specific to the agency. 

Staff must be open to being monitored by 
supervisors for quality implementation (fidelity) 
to the FFT model. 


Possible barriers: 

As identified by the developers, two barriers 
to implementation are funding to sustain FFT 
and the referral process to maintain a consistent 
caseload of appropriate FFT clients. These two 
issues seem to pose the greatest challenge 
to implementation efforts (Kopp, 2006). 


Training/coaching and Materials 

The training of staff in the use of FFT is a systemic 
process that is gradually phased in and usually 
occurs over a 1-year period, though different levels 
of certification require additional time. To become 
a trained FFT user, specific steps must be followed. 
Additionally, FFT has four levels of certification: 

FFT therapist: 

■ Requires 1 year of training with supervision 
and followup support. 

FFT clinical supervisor: 

■ Requires 1 year of training as a FFT therapist 
(see above), an additional year of training with 
supervision and followup support, plus the 
supervision courses necessary to receive 
designation as a certified FFT clinical supervisor. 

■ Such staff generally are clinically responsible 
for all cases of FFT and for providing group 
and individual supervision within agencies. 

FFT Clinical Supervisors carry a minimum 
number of active cases. 


no 
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FFT Trainers: 

■ Requires all training at the clinical supervisor 
level plus a supervised course, ongoing 
consultation in FFT training, and active 
participation in the FFT Inc. organization. 

To be considered a certified site, the following 
components are necessary: 

■ Two-day initial onsite clinical training; 

■ Clinical FFT externship for one member 
of the site; 

■ Two-day offsite team clinical training; 

■ Followup training and supervision visits 
(three visits per year at 2 days each); 

■ Weekly phone consultation in Year 1, biweekly 
phone consultation for team lead in Year 2; 

■ Supervision consultants with FFT supervisors 
for first 2 years of implementation; and 

■ Use of all components of FFT Family 
Assessment Protocol and Clinical Services 
System, and appropriate caseload and team size. 

FFT, LLC has a built-in infrastructure to handle 
requests for training, support, and materials. 

In relation to capacity for training, FFT, LLC 
employs and contracts 25 to 35 people, ranging 
from IT technical support to administrative and 
clinical personnel. 

Training materials are available to families 
in English and Spanish. 


Contact for training and implementation: 

Holly DeMaranville 
Functional Family Therapy, LLC 
1611 McGilvra Boulevard East 
Seattle, WA 98112 
Cell phone: (206) 369-5894 
Fax: (206) 664-6230 
Email: hollyfft@comcast.net 
Web site: http://www.fftinc.com. 


Cost of training/consulting 

■ Detailed information about cost 
of implementation is available at 

http://www.fftinc.com. 

■ The cost associated with Phase 1, including 
implementation and training of three to eight 
therapists to become certified FFT users, an 
externship, assessment, onsite clinical training, 
ongoing telephone consultation, three followup 
site visits, and offsite team training in Indiana, is 
$36,000, plus the cost of staff travel. 

■ The cost associated with Phase 2, including 
site certification supervision training, phone 
consultations, and followup onsite training, 
is approximately $18,000. 

■ Other ongoing FFT site certification training 
activities costs average $7,000. This includes 
onsite day visits, monthly hour-long phone 
consultations, and access to Clinical Services 
System (a web-based fidelity monitoring system). 
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Developer involvement 

The developers are still involved with the 
program, and do provide some initial and 
advanced clinical training. 


Monitoring fidelity and outcomes 

■ Staff at FFT, LLC help programs develop 
systems to collect and analyze data to make 
systemic improvements. 

■ A web-based monitoring system, the Clinical 
Services System, is used to monitor and 
report fidelity. 

■ Therapist notes are reviewed by expertly trained 
supervisors and results of the Counseling 
Process Questionnaire (completed by family 
members) are reviewed. 

■ Each site may use its outcome data to satisfy 
grant requirements or other fund-related 
requirements. FFT, LLC is mostly interested 
in increasing sites’ ability to use their data 

to improve adherence to the program. 


Financing the intervention 

FFT can be financed in various ways, depending 
on state policies and practices. For example, in the 
state of Washington, current legislation and funding 
is attached to programs such as FFT. In Pennsylvania, 
grant dollars are used to pay for FFT to develop 
a statewide quality improvement process for the 
Commission on Crime and Delinquency. 

Medicaid dollars may be used to pay for some of 
the services, but again it may be state dependent. 
FFT Medicaid codes are available in the states of 
New Mexico and Pennsylvania. Additionally, some 
states may use a Medicaid waiver, rehabilitation, 
or home-based and community-based service codes. 


Resources/links 

Federal Web site providing interactive tools and 
other resources to help youth-serving organizations. 

http://www.findyouthinfo.gov 

Functional Family Therapy, Inc. 

http://www.fftinc.com 

Office of Juvenile Justice and Deliquency 
Prevention Model Programs Guide. 

http://www2.dsgonline.com/mpg 
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Multidimensional Treatment Foster Care 


Intervention Description 


Background 

Multidimensional Treatment Foster Care (MTFC) 
was developed in the early 1980s by Patricia 
Chamberlain, Pli.D., and colleagues at the Oregon 
Social Learning Center to address serious and 
violent juvenile offenders who would otherwise 
need to be placed in a group or residential program. 

Thirteen years later, Philip Fisher, Pli.D., and 
colleagues developed the MTFC program for 
preschoolers (MTFC-P). This intervention is 
similar to the earlier developed MFTC but is 
tailored to meet the developmental needs of 
preschoolers who display early aggressive and 
acting-out behavior and can benefit from intensive 
treatment in the home and community. 

MFTC has been disseminated in many states 
and countries, such as Great Britain, Sweden, 
and the Netherlands. Within the last 2 years, 
more than 65 organizations have implemented 
MTFC (P. Chamberlain, personal communication, 
June 6, 2007). 


Characteristics of the intervention 

MTFC is delivered by trained treatment families to 
provide intensive supervision and support to children 
and adolescents at home, in the community, and at 
school. MTFC and MTFC-P children considered 
eligible for services are those who are at risk of 
being placed or are currently placed outside the 
home in the child welfare, mental health, or 
juvenile justice systems. Therefore, many of the 
children referred to MTFC and MTFC-P come 
from one of these agencies. 


Figure 18 


Multidimensional Treatment Foster Care 

Type of EBP 

■ Intervention 

Setting 

■ Clinic 

■ Home 

■ School 

Age 

■ 3-18 

Gender 

■ Males 

■ Females 

TrainingfMaterials Available 

■ Yes 

Outcomes 

■ Decrease in arrest rates. 

■ Decrease in violent activity 
involvement. 

■ Fewer runaways. 

■ Less chance of incarceration 
after completing program. 

■ Fewer permanent replacement 
failures (MTFC-P). 


Treatment families are recruited and screened 
before youth are placed in their homes. Formal 
training, ongoing supervision, and weekly meetings 
with parents are held to help families address 
problems and to note youth progress. A trained case 
manager connects daily with the treatment family 
and is also available to the child’s biological family. 

In both MTFC and MTFC-P, the goal is for the 
youth to continue to sustain contact with his or her 
biological family and for that family to get services 
while the child is in placement so that they are 
better prepared when the child returns home. 
Youth participate in skill-enhancing therapy. 

Treatment families maintain close contact with the 
schools about their child’s behavior and progress 
in the school environment. If the youth is involved 
with a probation system or other youth system, the 
case manager helps the youth and treatment family 
maintain contact. 
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Research Base and Outcomes 

MTFC has been researched extensively since 
1990. The research base includes randomized 
control trials examining the effect of the 
intervention over control groups (retrieved from 

http://www.mtfc.com/program_effectiveness.html). 

Across studies, evidence supports the intervention. 
Specifically, the research on adolescents has 


found that youth in MFTC have fewer runaway 
incidences and are arrested less often than youth 
in group care. Research supports that MTFC 
youth have significantly fewer days in locked 
settings (detention, training schools, hospitals, etc.) 
at followup, (http://www.mtfc.com). For preschool 
children, those in MTFC-P had fewer placement 
disruptions in followup. Further information about 
MFTC studies is presented in Table 18. 
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Table 18: Multidimensional Treatment Foster Care: Research Base and Outcomes 


Reference Research Design and Sample* Outcomes 

Eddy, Bridges, & Randomized control trials, youth (n = 79), assigned to either MTFC group 
Chamberlain (2004) or service as usual/ group care. 

Data collected every 6 months for 2 years. 

Study population: 

■ 100% male 

■ 85% White 

■ 6% African American 

■ 6% Hispanic 

■ 3% American Indian 

Fisher, Burraston, Randomized control trial of children (n = 90, ages 3-6) assigned to foster Children in the MTFC-P program experienced fewer 

& Pears (2005) care placement or MTFC-P placement. permanent placement failures. 

Study population: 

■ Male 63% 

■ Female 37% 

■ 85% White 

■ 11% Hispanic 

■ 4% American Indian 

Leve, Chamberlain, Randomized control trial of girls with chronic delinquency (n = 81, 

& Reid (2005) ages zl 3-17) assigned to either MTFC or group care (GC). 

Study population: 

■ Female 100% 

■ 74% White 

■ 12% American Indian 

■ 9% Hispanic 

■ 2% African American 

■ 1 % Asian American 

■ 2% Other or Mixed Ethnicity 

Chamberlain (1990) Youth committed to state training schools (n = 32, ages 12-18), matched TFC participants spent fewer days incarcerated, 
comparison design on age, sex, and date of commitment. Youth selected 
for either Treatment Foster Care (TFC) group or another community 
based treatment. 

Followup period of 2 years. 

Study population: 

■ Male 62.5% 

■ Female 37.5% 


* Study sample's gender and race/ethnicity data provided when available. 


MTFC youth had a greater reduction in the number 
of days spent in locked settings and in caregiver- 
reported delinquency. 

MTFC group has 42% fewer criminal referrals than 
GC youth at 12-month followup. 


MTFC youth were significantly less likely to commit 
violent offenses; 5% of MTFC youth had two or 
more criminal referrals for violent offenses at 2 years 
compared to 24% of the control group. 
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Implementation and Dissemination 


Infrastructure issues 

Readiness: 

The formal readiness process involves a conversation, 
a self-evaluation form, and, if needed, a site visit. 

A discussion is held with the site to determine 
whether it is advantageous to bring this program 
to their site. 

A readiness checklist is used as a resource. Before 
sending the checklist, an initial conversation is held 
and a packet of information is sent. After receipt 
and completion of the readiness checklist by the 
site, the Oregon team reviews the checklist and 
further discusses the process. 

Staffing: 

Criteria are available for MTFC and MTFC-P 
sites that outline the staff best suited to implement 
the program. 

Possible barriers: 

Challenges for both MTFC and MTFC-P include 
funding, the need for solid organizational structure 
with key champions helping to drive and sustain 
implementation efforts, and the need for practitioner 
commitment to the model. 


Training/coaching and materials 

TFC Consultants, Inc. disseminates MTFC 

(http://www.mtfc.com). 

■ Four trainings are offered per year in Eugene, 
Oregon. Each site sends a team of key 
professionals, including a supervisor, to attend 
the training. The training for program supervisors 
lasts approximately 5 days. The remaining 

key professionals attend 4 days of training. 

The training uses didactic and role- playing 
instruction methods. In addition, the attendees 
also observe a foster parent meeting with 
a supervisor. 

■ Upon completion of the staff training, the 
MTFC or MTFC-P program is ready for 
implementation. Members of the Oregon 
team come to the site to conduct the first 
foster parent meeting with site staff observing. 
After this meeting, telephone calls with the site 
consultant and review of videotaped foster 
parent and clinical meetings are conducted. 

■ Up to 6 days of onsite consultation are 
available to sites throughout the startup 
and implementation. 

■ Typically, sites will be fully operational after 
a full year. 

■ Sites can become MTFC or MTFC-P certified 
after successfully graduating seven youth. The 
criterion-based certification requirements are 
available on the MTFC Web site. A self- 
evaluation tool is available, but the certification 
review is conducted by a research group not 
connected with the program’s disseminating 
group, TFC Consultants. Initial certification 
lasts 1 year; recertification can last up to 2 years. 
TFC Consultants are available to offer support 
to those sites that are not ready for certification. 
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For information on training and materials, contact: 

TFC Consultants, Inc. 

Gerard Bouwman, President 
Telephone: (541) 343-2388 ext. 204 
Cell phone: (541) 954-7431 
Fax: 541-343-2764 
gerardb@mtfc.com 

Center for Research to Practice 
Rebecca Fetrow 
Program Evaluation 
Telephone: (541) 343-3793 
beckyf@cr2p.org 


Cost of training/consulting 

■ There is no cost for the readiness process, 
unless a site visit is required. 

■ The cost to implement either MTFC 
or MTFC-P is $40,000 to $50,000. 


Developer involvement 

■ MTFC: The developer, Dr. Patricia Chamberlain, 
is still involved in disseminating the program. 

■ MTFC-P: The developer, Philip Fisher, PhD, 
is currently involved in disseminating the 
preschool program. 


Monitoring fidelity and outcomes 

■ Fidelity measures exist for both MTFC and 
MTFC-P. TFC Consultants collect fidelity 
data from sites. 

■ The reporting of outcomes is required when 
implementing MTFC and MTFC-P to obtain 
certification. 


Financing the intervention 

Many sites apply for grant dollars and use funds 
from child welfare, early childhood special 
education funds, and county mental health funds 
to finance the MTFC or MTFC-P intervention. 
Sites with an older youth population have used 
juvenile justice funding. 

The treatment foster care element of the 
intervention may be covered by Medicaid. 


Resources/Links 

http://www.mtfc.com 
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